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AN  ABSTRACT 


THE  IDENTIFICATION  OF  OVERDAMPED  PROCESSES 
IN  THE  TIME -DOMAIN 

by 

Jerry  M.  Mendel 
Advisor:  Dr.  Ludwig  Braun,  Jr. 


The  problem  of  characterizing  overdamped  systems,  from  data  in  the  time- 
domain,  by  means  of  exponential  functions  is  studied.  Particular  attention  is  given  to: 

(1)  the  choice  of  a  suitable  error  criterion  based  upon  performance  measures  the  approxi¬ 
mate  system  is  to  meet,  (2)  the  choice  of  weighting  functions  and  their  effect  on- the 
approximations,  and  (3 )  the  extension  of  the  orthonormal  exponential  approximations  of 
Kautz  and  Huggins  to  approximations  of  any  asymptotic -order  in  the  s -domain. 

The  spirit  of  the  research  carried  out  is  in  keeping  with  the  philosophy  that 
the  approximate  system  will  replace  the  actual  system  in  practical  analyses.  For  ex¬ 
ample,  the  actual  system  may  be  embedded  in  the  forward  path  of  a  positional  servo¬ 
mechanism.  If  a  stability  analysis  of  the  closed-loop  system  is  to  be  performed  then 
it  is  desirable  for  the  approximate  plant,  which  will  be  used  in  the  stability  analysis, 
to  indicate  the  correct  stability  behavior  within  an  allowable  margin  of  error.  Since 
stability  is  intimately  connected  with  high-frequency  behavior  it  appears  to  be  desirable 
to  be  able  to  match  the  high-frequency  behavior  of  the  actual  and  approximate  systems. 
This  naturally  leads  to  the  choice  of  exponential  approximants  of  asymptotic-order,  in 
the  s -domain,  greater  than  unity. 

In  each  of  the  above  areas  of  concentration,  emphasis  is  placed  on  the  effects 
that  the  asymptotic-order  will  have  on  the  utility  of  the  approximations  in  further 
anaylses. 
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CHAPTER  I.  INTRODUCTION 
I.  1 _ Introductory  Remarks 

In  both  analysis  and  synthesis,  it  is  necessary  to  be  able  to  characterize 
a  system  by  means  of  a  mathematical  model.  In  simple  cases,  this  can  be  done  by 
writing  the  differential  equations  describing  the  system  and  then  solving  them  for  the 
desired  input-output  ratio.  In  many  cases,  however,  the  system  is  so  complex  that 
the  only  feasible  methods  for  obtaining  a  model  are  experimental  in  nature.  These 
measurements  can  be  made  in  either  the  frequency-domain  or  in  the  time -domain. 

Many  problems,  such  as  determining  what  measurements  to  make,  whether  to  use  per¬ 
iodic  or  aperiodic  inputs,  etc.  ,  exist  in  connection  with  the  practical  aspects  of  making 
these  measurements.  Assuming  that  the  correct  measurements  have  been  made,  it 
shall  be  our  purpose  to  concentrate  on  the  representation  of  these  measurements  by 
means  of  a  suitable  working  model.  This  is  the  "identification  problem"  . 

Within  the  last  decade  a  great  deal  of  attention  has  been  focussed  upon  the  time- 
domain  characterization  of  processes.  Obviously,  one  important  reason  for  such  a 
characterization  has  to  do  with  the  economy  of  a  single  transient  test  as  compared  to 
the  multitude  of  frequency  tests  necessary  to  obtain  the  same  amount  of  information. 

This  trend  has  been  noticeable  not  only  in  the  field  of  network  synthesis,  where  it 
originated,  but  also  in  the  areas  of  adaptive  control,  optimal  control  theory,  electro¬ 
cardiography,  and  speech-signal  representation. 

Most  of  the  past  research,  in  the  area  of  identification  of  processes  in  the  time- 

domain,  has  been  concerned  with  achieving  a  close  fit  between  the  model  and  the  data, 

the  closeness  of  fit  being  measured  by  the  integral- squared  error  criterion.  The  in- 

18  15  17 

troduction  of  the  orthonormal  exponentials  by  Kautz  and  Huggins  ’  aided  the  approxi¬ 
mators  immeasurably,  for  their  work  enabled  one  to  approximate  exponential  responses 
by  exponential  signals.  These  approximations  not  only  lend  themselves  quite  nicely 
to  further  analysis  involving  transform  techniques,  but  are  also  in  a  form  amenable 
to  network  realization;  hence,  they  are  useful  in  both  the  analysis  and  synthesis 
problems. 

Unfortunately,  ensuring  a  close  fit  between  the  approximation  (model)  and  the 
actual  system  does  not  necessarily  lead  to  a  close  correspondence  between  the  two  with 
respect  to  other  properties  of  the  system.  For  example,  approximating  the  plant 
f(t)  in  Figure  I.  1.  1  may  only  be  the  first  step  in  a  detailed  analysis  of  the  closed-loop 
system  in  which  this  plant  is  embedded. 
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(a) 


(b) 


Figure  I.  1.  1.  A  typical  feedback  system  in  which  the  plant  f(t)  in  (a) 
is  approximated  by  fa( t )  in  (b  ). 


In  particular,  if  one  is  interested  in  the  stability  of  the  closed-loop  system, 
then  there  should  be  some  correspondence  between  A.  O.  and  A.  O.  (F),  since  the 

high-frequency  behavior  of  the  plant  determines  whether  or  not  the  closed-loop  system 
becomes  unstable  as  the  loop  gain  increases.  To  illustrate  the  importance  of  this  last 
sentence,  consider  a  plant  f  (t )  whose  poles  and  zeros  all  lie  in  the  left-half  of  the 
s  -plane,  and  whose  asymptotic -order  is  four.  Not  knowing  the  value  of  A.  O.  (F)  ahead 
of  time,  assume  that  a  model,  f a (t ),  has  been  chosen  to  approximate  the  actual  plant 
where  A.  O.  (Fa.)  =  2  .  It  is  well  known  that  for  large  enough  values  of  the  loop  gain 
the  actual  closed-loop  system  does  become  unstable.  The  approximation,  on  the  other 
hand,  which  may  give  a  very  good  fit  to  f  (t),  indicates  that  the  closed-loop  system 
never  becomes  unstable  (this  last  phrase  tacitly  assumes  that  Fa(s)  has  no  zeros  in  the 
right -half  of  the  s -plane);  thus,  when  one  plans  to  utilize  the  approximation  in  future 
analyses,  there  appears  to  be  more  to  the  identification  problem,  in  the  time -domain,, 
than  merely  achieving  a  close  fit  between  the  approximant  and  the  true  response.  In 
control  systems  analyses,  the  asymptotic  order  of  the  plant1  s  model  is  of  great  impor¬ 
tance,  as  has  been  mildly  demon  strated  in  the  preceding  sentences. 

Rather  than  belabor  the  point  at  this  time,  the  interested  reader  is  referred  to 
the  introductory  sections  of  Chapters  1-4  for  more  detailed  introductory  remarks.  This 
chapter  is  concluded  with  a  brief  discussion  of  the  actual  problem  studied  and  some  of 
the  assumptions  made  in  the  formulation  of  the  problem. 


*  A.  O.  (Fa.  )  is  read  "asymptotic-order  of  Fa  (s)"  and  is  defined  by  looking  at  the 

lim  F  (s )  =  and  letting  A.  O.  (F  )  =  n. 

s— oo  a '  '  n  °  a 
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I.  2  Statement  of  the  Problem 

An  identification  of  the  system  in  Fig.  I.  2.  1  is  desired.  The  transfer  func¬ 
tion  characterizing  the  system  is  to  be  of  the  following  form: 


T(s) 


Kn 


v  .  v-1  , 

s  +  a  ,  s  +  .  . 
v-1 


+  a.  s  +  a_ 


fj  (  S  +  mf  > 

l  =0 


(1.1) 


Only  the  poles  of  T  (s)  must  lie  in  the  left-half  of  the  s-plane.  The  zeros  may  be 
negative  and  real,  positive  and  real,  or  complex.  Since  the  impulse  response  of  this 


Figure  I.  2.1.  A  description  of  the  system  which 
is  to  be  identified  . 


A’*  t 

system,  quite  obviously,  is  of  the  form  Y  A,  e  mk  ,  where  the  m,  are  real, 

k  =  0  K  K 

it  shall  be  approximated  by  a  similar  set  of  functions,  that  is 


f  (t)  S  fa  (t) 


n 

Jo 


(1.2) 


where  the  f  (t)  are  linear  combinations  of  exponential  functions.  This  study  is 

limited  to  real  exponents  (overdamped  processes)  for  two  reasons.  First,  almost 
no  work  has  been  done  in  the  area  of  approximating  overdamped  processes  of  high 
asymptotic-order,  and  secondly,  the  introduction  of  complex  poles  info  Eq.  (I.  1) 
vastly  increases  the  analytical  complexity  of  the  problem. 

It  was  felt  that  a  concentrated  study  in  one  aspect  of  the  more  general  identi¬ 
fication  problem  might  lead  to  results  that  could  easily  be  extended  to  the  more 
general  case.-  It  is  also  possible  that  by  narrowing  one'  s  objectives  he  will  discover 
theory  that  is  particularly  amenable  to  the  case  of  real  exponents.  This  may  be  com¬ 
pletely  overlooked  in  a  more  general  study.  As  it  turned  out  theory  was  developed 
that  justified  narrowing  the  scope  of  the  problem.  Actually,  there  are  many  systems 
that  occur  quite  frequently  in  practice  satisfying  the  requirements  of  Figure  I.  2.  1, 
as  stated  in  Eq.  (I.  1). 
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It,  is  assumed  that  the  internal  construction  of  the  system  in  Figure  I.  2.  1  is 
unknown  and  that  only  the  external  terminals  are  available  for  the  application  of 
test  signals.  In  order  to  determine  whether  or  not  the  system  meets  the  requirements 
of  Eq.  (I.  1)  one  must  be  able  to  correlate  the  form  of  the  time  response  y  (t)  with 
possible  pole-zero  locations  in  ¥  (s)  .  Table  I.  2.  1  presents  a  number  of  t-domain 
--  s-domain  correlations  which  are  useful  in  the  analysis.  It  is  based  upon  a  set  of 
ingenuous  theorems  proven  by  Brule  ^  in  his  Ph.  D  dissertation. 

The  problem  before  the  analysist  is  one  of  choosing  a  proper  set  of  f  (t)  in 

‘He 

Eq.  (I.  2)  and  then  determining  the  Cj  based  upon  a  minimization  of  some  measure  of 
the  error  between  f  (t)  and  £a(t ).  This  error,  e  (t),  is  defined  in  Eq.  (I.  3). 

e  (t)  =  f  (t)  -  f  (t)  (1.3) 

d 

It  is  convenient  to  use  the  functional  notation  F  j^vjj  (e )  ,  w(t)j  to  represent  a  measure 
of  the  error  that  must  be  minimized,  in  order  to  find  the  .  The  (e)  notation  is 
short  hand  for  "an  operator  41  acting  upon  e  (t )"  ,  and  w(t)  is  known  as  a  weighting 
function.  w(t)  can  be  chosen  so  as  to  weight  the  approximation  heavily  over  certain 
intervals  of  time  and  lightly  over  others.  F^  (e)  ,  w(t)j  is  more  commonly  known 
as  an  error  criterion.  As  an  example,  consider  the  I  T  E2  criterion  defined  in  Eq.(1.4). 


ITE2  =  f  t  e2  dt 
Ja 


(1.4) 


This  equation  can  be  put  into  the  functional  form  F  ^ iJj  (e )»  wU)j  by  letting  w(t)  =  t, 

vj,  (e)  =  e2  ,  and  F  =  f  dt.  Note  that  the  functional  notation  for  the  ITE  criterion 
‘  o 

is  consistent  with  the  mathematical  definition  of  a  functional,  that  is  to  say,  it  is  a 
pure  number.  The  weighting  function,  in  this  case  w(t)  =  t,  quite  obviously  emphasizes 
large  values  of  t. 


In  the  following  four  chapters,  the  choice  of  the  approximants  f  (t)  j^chap- 
i  r  nk 


ters  1, 

3  and  4J  , 

de  sign  | 

chapters 

mations 

(chapter 

*  ITE2 

is  read,  1 

abbreviation  ITSE  instead  of  ITE2  .  Both  abbreviations,  however,  are  merely 
shorthand  notations  for  the  integral  in  Eq.  (I.  4). 


TABLE  1.2.1  SOME  s-DOMAIN  -  t-DOMAIN  CORRELATIONS. 


y  tt) 

-o 


X(t)  T  (s)  y  (t)  COMMENTS 
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CHAPTER  1.  UNIFORMLY -WEIGHTED,  ORTHONORMAL, 

EXPONENTIAL  APPROXIMANTS 

In  this  chapter  the  integral-squared-error  criterion  is  reviewed  and  a  proce¬ 
dure  for  constructing  sets  of  orthonormal  exponential  approximants  is  developed,  in 
which  any  desired  asymptotic-order  may  be  designed  into  the  Laplace  transform  of 
the  approximants,  ahead  of  time.  These  approximants  are  summarized  by  a  recur¬ 
sion  equation  in  the  time-domain. 

1.  1  Introduction 

2 

The  integral-squared-error  criterion  (IE  )  is  perhaps  the  most  widely  known 
and  used  measure  of  performance  for  time-domain  approximations.  The  term 
"time-domain"  is  used  here  to  denote  the  interval  of  time  from  zero  to  infinity,  that 
is  t  e  (  0,  oo  ).  A  function  f(t)  is  said  to  be  approximatedHn  an  "  integral- squared 

sense"  when  it  is  approximated  by  the  function  (t)  =  ^  <j>^  (t)  in  such  a  way 

k  =  0 

2  2 
that  the  IE  is  a  minimum.  Given  the  definition  of  the  IE  criterion, 

—  CO  2 

IET  =  f  w(t)  |^f  (t)  -  fa(t)J  dt  (1.1) 

18  28  2 
it  is  well  known  ’  that  the  minimum  IE  is 


min  (IE2)  =  f  w(t)f2(t)dt-  C  2  (1.2) 

o  k  =  0 

provided  the  elements  ^  (t)  form  an  orthonormal  set  with  respect  to  the  weighting 
function  w  (t)  over  the  interval  of  time  (  O',  oo)  .  The  condition  for  the  orthonormality 
of  the  (t)  is  stated  in  Eq.  (1.  3). 

1,  i  =  j 

oo  J 

/  w(t)  (t)  <j>j  (t)  dt  =  6  =  0>  i  _/  j  (1.3) 

r  2  2 

I  Strictly  speaking  one  should  indicate  that  min  (IE  )  is  the  minimum  IE  with  respect 

to  the  coefficients  C,  in  f  (t).  It  will  be  shown  that,  under  certain  conditions,  the 
k  -•  o,  t 

<(),  (t)  can  be  formed  from  linear  combinations  of  terms  of  the  form  e  k  ,  where 
k 

the  exponents  cl^  are  unknown.  Liu  points  out  that  the  determination  of  the  from 
a  minimization  of  the  IE^  with  respect  to  the  involves  lengthy  and  laborious  com¬ 
putations,  and  what*  s  more,  the  solution  is  not  unique.  It  shall  be  assumed,  through¬ 
out  this  entire  dissertation,  taat  the  a^_  have  been  specified  a  priori  (see  Appendix  A 


*  e  is  a  mathematical  shorthand  notation  for,  "is  an  element  of"  . 
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for  a  discussion  of  a  restriction  pertinent  to  the  choice  of  these  exponents).  The 

2  2 
notation  min  (IE  )  will  therefore  always  denote  a  minimization  of  the  IE  with,  re¬ 
spect  to  the  coefficients  .  1  As  a  result  of  the  minimization  the  coefficients 
are  found  to  be 

oo  ' 

Ck  =  J  w(t)f(t)^(t)dt  (1.4) 

It  is  quite  evident  from  this  equation  and  Eq.  (1.  2)  that  the  addition  of  an  extra  term 
Cn  +  ^  ‘t’n  +  1  (t)  to  ^  *n  n0  way  allects  any  of  the  previously  calculated  C^'  s  and 

2  2 

will  tend  to  decrease  the  min  (IE  )  by  (C^  4-  j)  •  This  represents  the  advantage  of 
choosing  an  orthonormal  set  of  functions  (t)  as  compared  to  a  non-orthonormal 
set  of  approximants. 

Before  proceeding  to  a  discussion  of  how  one  constructs  the  orthonormal  set 
of  functions  <j).  (t)  ,  it  will  be  well  to  point  out  the  importance  of  the  infinite  interval 
(0,  00)  .  The  following  discussion  is  taken  directly  from  Kautz1  s  original  research 

report.  "  It  may  be  safely  said  that  the  number  of  practical  problems  in  which  pre¬ 
cise  transient  behavior  is  desired  over  the  entire  interval  (0,  00)  is  extremely  small. 
Furthermore,  for  sufficiently  large  t,  the  response  must  drop  off  to  zero  either 
exponentially  or  as  an  exponentially  damped  sinusoid,  so  that  no  other  type  of  behav¬ 
ior  at  infinity  can  be  obtained,  even  if  it  were  desired.  "  (Kautz  has  tacitly  assumed, 
in  this  last  statement,  that  all  recognizable  components  of  the  response  being  identi¬ 
fied,  such  as  a  d-c  component  or  a  sinusoidal  steady  state  component,  have  been 
removed  by  means  of  subtraction.  The  approximation  is  then  made  upon  the  remain¬ 
ing  signal.  )  "One  might  very  well  reason,  then,  that  methods  for  approximating  a 
function  should  be  developed  over  only  a  finite  interval.  That  this  conclusion  is  in¬ 
correct  is  brought  out  by  the  following  three  facts: 

(1)  If  a  finite  interval  is  employed,  almost  nothing  can  be  specified  about  the  tran¬ 
sient  outside  of  this  interval  using  existing  approximation  methods.  It  may  behave  very 
erratically,  and  as  a  rule  it  cannot  be  controlled. 

(2)  The  use  of  an  infinite  interval  does  not  imply  that  equal  emphasis  is  given  in  the 
approximation  to  all  sections  of  the  time  scale.  In  fact,  normally  very  little  weight 
is  placed  on  reproducing  the  response  for  large  values  of  t  . 

(3)  It  is  difficult  to  carry  out  the  analytical  approximations  over  a  finite  interval.  " 

The  problem  now  i6,  "  how  does  one  construct  the  orthonormal  set  of  functions 

*k(t)  7" 

The  answer  to  this  question  can  be  given  by  appealing  to  the  Gram-Schmidt 
18  28 

Orthonormalization  Procedure  ’  ,  which  states  that  a  unique  set  of  orthonormal 

functions  <j>k  (t)  can  always  be  formed  from  a  set  of  linear ly-independent  functions 
g^  (t)  ,  in  the  following  way: 
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♦c  (t)  =  Xo  §0  (t) 

+  1  (t)  =  Xl[go  (t)  +  x2  8l  (t>]  .  (1>5) 

+k(t)  =  Xm|>o  (t)  +  Xi  (t)  +  --'  +  Xj«k(t)] 

The  constants  X  are  determined  by  substituting  these  equations  into  Eq.  (1.  3), 
which,  depending  upon  the  choice  of  the  g^(t),  usually  represent  a  formidable  set  of 
simultaneous  linea.r  equations  in  the  X^,  from  which  these  constants  must  be  solved 
for. 

Since  this  discussion  is  being  limited  to  the  identification  of  the  functions 
N  _  . 

f  (t)  =  Jj  \  e  _mk  ,  mk  real  (1.6) 

k  =  0 

it  seems  natural  to  choose  the  g  (t)  as  an  exponential  set  of  functions.  If  in  particular 


-  a  „  t  . 


(t)  .{«  1  } 


l  =  0,  1, 


(1.  7) 
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Kautz  has  shown  that  the  result  of  the  Gram-Schmidt  Procedure  can  be  expressed 
very  neatly  in  the  frequency-domain,  provided  a  constant  weighting  function,  w  (t), 
is  used.  This  is  the  "uniformly-weighted"  case.  As  a  matter  of  fact,  he  has  shown 
that  the  entire  orthonormalization  procedure  can  be  carried  out  in  the  s -domain  by 
means  of  Parseval’  s  Equation'  and  Cauchy1  s  Residue  theorem,  the  results  being 

1 


$  (s )  =  /2  a 
o  V  o 


s  +  a 


*1 (s)  V2  ai 


(s  -  ao) 

(s  +  a.Q)(s  +  aL) 


_  (s  -  aQ).  .  .  (s  -  ak  _  ^ 

®  k  ^ S  ^  V2  ^  (s  +  a  )(s  +  a  )  .  .  .  (s  +  a 
v  0  1  k 


for  w  (t)  =  ]. 


(1-8) 


22 

’'I'Parseval1  s  Equation  states  that 


c  +  j  00 


f  h  (t)h  (t)dt  =  -U  f  H  (s)H2(-s) 

o  ^  77  J  C  -  j  00 


d  s 
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-2bt 

e 


Braun  1  has  extended  these  results  to  an  exponential  weighting  function, 
In  this  case 


$  (s  =  /2(b  +  a  , — 

o  '  V  '  o'  (s  +  a ) 

o ' 

(s  -  2b  -a  ) 

®1  (  9  )  %/Z(h  +  V  (s  T  ao)<s  +  ) 


[  (I-  9) 


\(s)  V2  (b  +  ak) 


(s  -  2b  -  aQ).  .  ,  (s  -  2b  -  ^  ) 

(3  +  ao)(s  +  a.),  ,  ,  (s  +  Oj J 


A  discussion  of  choosing  one  form  for  the  weighting  function  over  another 
will  be  put  off  at  this  time  until  Chapter  2.  In  that  chapter  a  great  deal  will  be  said 
about  weighting  functions,  in  general,  including  the  two  cases  of  a  constant  and  an 
exponential. 


n 

It  is  obvious  from  Eqs.  (1.  8)  and  (1.  9)  and  the  fact  f  (t)  =  ^  ^ 

k  =  0 


that  Fa(s)  will  always  nave  an  asymptotic-order  equal  to  unity,  since  A.  O.  (F&)  equals 
A.  O.  (<3^),  and  A.  O.  (3^)  is  equal  to  unity.  It  is  also  interesting  to  note  that  if 
S^fs)  is  considered  to  be  the  transfer  function  of  a  linear  filter,  then  ^(t),  which  is 
the  impulse  response  of  the  filter,  will  be  oscillatory  (Table  I.  2.  1),  and  in  fact  will 
contain  exactly  k  internal  crossings  of  the  t-axis,  provided  k  >  1. 


Practically  speaking,  if  the  function  f(t),  which  is  to  be  approximated  by 
f a( t ) ,  has  a  non-zero  initial  value  (at  t  =  0  +  )  then  Kautz1  s  (Braun1  s)  results  represent 
the  natural  choice  for  the  <t>^(t).  This  does  not  mean  that  the  one  term  approximation 
CQ  <j>o  (t),  or  the  two  term  approximation  C 0 ( t )  +  Cj<j>j(t),  or  even  the  ten  term  approxi¬ 
mation  CQ  4>0  (t)  +  .  .  .  +  Cg  <j>q  (t),  where  the  <j>^  (t)  are  found  from  Eq.  (1.  8 )  |or  Eq. 

(1.  9 )  j  ,  will  match  the  initial  value  of  f(t)  exactly.  What  is  meant,  is  that  in  the  limit, 
as  more  and  more  terms  are  added  to  the  approximation,  the  initial  value  of  the  ap¬ 
proximation  will  coincide  with  the  non-zero  initial  value  of  f(t).  This  is  due  primarily 
to  the  facts  that  A.  O.  (Fa)  =  A.  O.  (F)  ,  and  that  both  of  these  are  equal  to  unity. 

On  the  other  hand,  if  f(t)  has  a  zero  intial  value,  and  (r  -  1)  zero  initial 
derivatives  at  t  =  0+  ,  where  r  must  somehow  be  determined  from  the  given  f  (t) 
data,  it  would  make  much  more  sense  to  choose  a  set  of  <(>,  (t)  having  a  similar  behav- 
ior  at  t  =  0  .  This  means  choosing  a  set  of  (t)  such  that  A.  O.  (3^)  =  r+1  . 
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This  last  result  was  found  by  applying  the  Initial  Value  theorem,  from  Laplace 
Transform  Theory,  r  times  to  a  function  of  asymptotic -order  r  +  1,  and  observing 
that  the  initial  value  and  exactly  (r  -  1)  initial  derivatives  of  that  function  vanish.j 
This  argument  can  be  amplified  by  considering  f  (t)  to  be  the  identification  of  a  plant 
f (t ),  such  as  the  one  shown  in  the  forward  path  of  the  simple  positional  servomech¬ 
anism,  Fig.  1.1.1.  The  absolute  stability  of  this  closed-loop  system  jusing  the  approxi’- 
mate  plant  fa  (t)jwill  depend  upon  the  asymptotic-order  we  have  chosen  for  (t), 
as  we  have  already  indicated  on  page  2.  It  is  well  known  that  if  the  A.  O.  (F)  >  3 
the  servomechanism  will  always,  become  unstable  for  sufficiently  large  values  of  loop 
gain.  The  use  of  an  approximation  having  an  asymptotic-order  equal  to  unity,  on  the 


(a)  (b) 

Figure  1.1.1.  A  typical  feedback  system  in  which  the  plant  f(t)  in  (a) 

is  approximated  by  f,  (t)  in  (b). 

3. 


other  hand,  implies  that  the  system  is  absolutely  stable;  that  is,  no  matter  how  large 
one  makes  the  loop  gain,  the  closed-loop  system  is  stable. 


It  seems  very  desirable,  therefore,  to  be  able  to  extend  Kautz1  s  and  Braun'  s 
results  to  cases  where  A.  O.  ($^)  *>  1.  It  also  would  be  particularly  advantageous  to 
the  user  to  have  such  sets  summarizable  either  iri  the  s-domain,  by  a  recursion  equa¬ 
tion  similar  to  Eqs.  (1.  8)  and  (1.  9),  or  in  the  time -domain,  whichever  may  be  more 
appropriate.  . 


5 

In  quest  of  such  relationships,  Braun  considered  the  general  set  of  <jj^(t) 
where  A.  O.  (3^)  =  2,  and  attempted  to  perform  the  orthonormalization  (with  respect 
to  a  unity  weighting  function)  in  the  s-domain  by  assuming 


$o  (s)  = 


(s)  = 


\ (s) 


( S  -I-  CL  )  (s  +  CL..  ) 

O  1 

E1  (s  +  |3q) 

(s  +  ao)(s  +  a^s  +  a_,  ) 


Tc-1 


(s) 


(s  *  pk-l} 

Ts  +  V 


(1.10) 
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Substituting  these  equations  into  the  s-domain  version  of  Eq.  (1.  3), 

tr  +  j  oo 

zVl  /  .  \  (s)  (“s)ds  =  6ij  <LU) 

J  0-  -  J  00  J  J 

and  applying  Cauchy1  s  Residue  Theorem,  by  closing  the  contour  in  either  the  right- 
half  or  the  left-half  of  the  s-plane,  |^due  to  the  analyticity  of  (s)  and  (-s)  in  the 
right-half  and  left-half  of  the  s-plane,  respectivelyj  one  is  confronted  with  a  very 
formidable  set  of  equations  which  must  be  solved  for  the  zeros  p  and  the  constants 
in  terms  of  the  poles  .  After  obtaining  a  few  of  the  zeros,  p^,  and  constants 
E^,  Braun  concludes  that  it  is  difficult  to  derive  a  general  recursion  formula  for  a 
set  of  <(>k  (t)  in  the  s-domain  in  terms  of  the  a^,  when  the  A.  O.  (<6^)  =  2.  This  does 
not  mean  that  such  sets  are  impossible  to  construct.  On  the  contrary,  it  implies 
that  one  should  choose  the  first  and  then  orthonormalize  the  elements  (t).  Natu¬ 
rally,  this  means  that,  each  time  the  set  of  o^.'  s  is  changed,  the  entire  orthonormal¬ 
ization  procedure  must  be  repeated.  In  general,  these  conclusions  are  valid  and  apply 
to  the  construction  of  any  set  of  <J>^  (t)  when  A.  O.  (<6.  )  >  1  ■ 

The  remaining  sections  of  this  chapter  are  devoted  to  the  case  of  "equally- 
spaced"  poles,  where  the  term  "  equally- spaced"  implies  that  -  a^_  ^  =  constant, 
in  Eqs.  (1.  8)  and  (1.  9)’V  It  will  be  shown  that,  in  this  case,  the  elements  (t) 
can  be  found  from  a  very  general  recursion  equation  in  the  time-domain.  What  is 
more,  it  will  be  proven  that  the  generality  of  this  equation  enables  one  to  use  it  to  con¬ 
struct  sets  of  or  thonormalized  exponentials  whose  Laplace  Transform  <1^.  (s)  can  be 
of  any  asymptotic-order,  whatsoever.  Rather  than  present  the  theory,  theorems  and 
proofs  in  their  entire  generality  all  of  the  important  results  shall  first  be  developed 
for  a  set  of  (t)  orthonormalized  with  respect  to  a  unity  weighting  function.  A  dis¬ 
cussion  of  a  weighting  function  which  is  much  more  general  than  the  type  Braun  has 
used  (e  ^  which  reduces  to  c  under  special  circumstances,  is  the 

subject  of  Chapter  2.  The  design  of  this  weighting  function  will  occupy  a  large  portion 
of  Chapter  2  since  its  design  is  necessary  for  the  synthesis  procedure  developed  in 
Chapter  3  for  obtaining  a  set  of  functions,  <j>^(t),  which  are  orthonormal  with  respect 
to  this  more  general  weighting  function.  Here,  again,  it  will  be  shown  that  the  asymp¬ 
totic-order  of  the  <6  (s)  can  be  chosen  with  complete  freedom. 


,f  The  zeros  are  the  orthogonalization  constants  while  the  constants  E^  ensure 
the  normality  of  the  (t). 

’'"More  will  be  said  about  this  type  of  pole  spacing  in  Sections  1.  3  and  B.  5. 
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To  set  the  stage  for  Section  1.  3,  in  which  the  recursion  equation  for  the 
elements  ^(t)  ’■s  derived,  one  must  first  discuss  a  set  or  orthonormal  polynomials 
known  as  the  Jacobi  Polynomials,  since  the  recursion  equation  will  be  expressed  in 
terms  of  these  polynomials. 


*  Actually,  Armstrong  ’  as  early  as  1957  indicated  a  correspondence  between 
the  orthonormal  exponential  set  and  the  classical  Jacobi  Polynomials  for  very 
special  sets  of  pole  locations  (see  Section  3.  1);  however,  he  never  considered 
the  more  general  nature  of  this  correspondence  or  the  possibility  of  extending 
Kautz1  s  work  to  the  case  of  a  more  general  weighting  function. 
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1.  2  Jacobi  Polynomials 

The  Jacobi  Polynomials  ’X  (a,  c;x)  are  m'  th  degree  polynomials  in  x  which 

21  m 

are  defined  by  the  following  series: 


*) 


r  (a  +  m  +  i  )  r  (c) 
r(a  +  m)  r  (c  +  f  ) 


.  I 


X 


(1.12) 


(-c  y  0,  1,  2 . m  -  1) 


They  are  orthonormal  with  respect  to  the  weighting  function  x  C~1  (i  _  x)a_c  over  the 
interval  (0,  1),  *  that  is 


/  x  C‘1  (l-x)a-C/m  (a>  C;  x>fn  (a'c;xldx 
o 

provided  that 


I<  6_ 


(’  13) 


c  >  0,  and  a  P  c  -  1 

Km  is  the  orthonormality  constant  and  is  shorthand  for 

K  =  m  '•  i  r  (c )]  r(ml  a-c  +1) 
m  (a  +  2m  1  F(a  +  m)r  c+m) 

In  Table  1.  2.  1  one  can  see  the  relationship  between  the  Jacobi  Polynomials 
and  some  of  the  more  classical  polynomials  of  mathematical  physics.  Actually,  the 
Legendre  polynomials  are  merely  special  cases  of  the  more  general  Gegenbauer 
Polynomials,  which  are  in  themselves  a  special  case  of  the  very  general  Jacobi  Poly¬ 
nomials.  If  one  considers  the  two  constants  a  and  c,  in^m(a,  c  ;  x),  as  represen-, 
ting  two  degrees  of  freedom,  then  the  Gegenbauer  Polynomials  are  a  set  of  polynomi 
als  having  one  degree  of  freedom  (  v)  while  the  Legendre  and  Tschebyscheff  poly¬ 
nomials  have  zero  degrees  of  freedom  in  the  sense  that  they  are  defined  by  assigning 
numerical  values  to  both  a  and  c  . 

The  purpose  of  relating  the  Jacobi  Polynomials  to  the  polynomials  listed 


(1.14) 


(1.15) 


2  8 

*  Szego  defines  the  Jacobi  Polynomials  orthonormal  over  the  interval  (-1,1); 
however,  to  differentiate  between  this  set  and  the  one  defined  above,  he  uses 
the  symbhl  P  'a’  P)(z).  A  linear  transformation  exists  between  the  variables 
z  and  x,  whicT  enables  one  to  use  either  notation.  Specifically,  Pm(a,c^  (2x-l) 


■r„ 


a,  c;.x) 
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in  Table  1.  2.  1  will  become  clear  in  Section  1.  4,  where  it  will  be  shown  that  many  of 
the  familiar  orthogonal  polynomial  approximations  of  a  function  can  be  rephrased  in 
terms  of  the  orthonormal  exponential  approximation. 

Table  1.  2.  1.  Relation  Between  Jacobi  Polynomials  and  More  Familiar  Polynomials 


ft 

Polynomial 

Relationship  to  Jacobi  Polynomials 

Gegenbauerf *  (x) 

m-  (-i r 

Legendre,  P  (x) 

©  m 

T  1  -  X  l/z 

=  Cm  <x> 

ftftft 

Techebyschexf,  T  (x) 
m 

Tm<*>  =Jm<°>  l/Z!  V1) 

Recurrence  formulae,  integral  relationships,  and  other  facts  about  Jacobi  Polynomials 

may  be  found  in  references  10,  21  and  28.  Page  300  of  reference  9  is  very  useful  for 

the  evaluation  of  the  Gamma  functions  appearing  in  Eqs.  (1.12)  and  (1.15).  Of  course, 

27 

when  the  argument  of  the  Gamma  function  is  an  integer,  say  v,  then  T(v)  =  (v-l)l 

One  is  now  in  a  position  to  derive  the  recursion  equation  for  the  elements 
(t)  of  the  set  of  orthonormalized  exponentials  in  terms  of  the  classical  Jacobi 
Polynomials. 


*  For  the  3tanda.rd  definitions  of  these  polynomials  see  Magnus  and  Oberhettinger 

**  v)  =  2 v  (2  v+  1)  (2 v  +  2)  .  .  .  (2v  +  m  -  l);  (2v)o  =  1 

***  T  (x)  is  a  Tschebyscheff  Polynomial  of  the  first  kind  to  be  distinguished  from 
the  Tachebyscheff  Polynomials  of  the  second  kind,  (x)  (Ref.  21,  pg.  78). 
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1.  3  4>k(t):  A  Recurrence  Equation  in  the  Time -Domain 

By  transforming  the  domain  of  orthonormality  for  the  Jacobi  Polynomials 
lf’m  (a,  c;x)  from  (0,  1)  in  the  x-domain  to  (0,  oo)  in  the  t-domain,  letting 


where  p  is  some  positive  constant,  Eq.  (1.13)  becomes 


oo  .  a-c 

f  e  cpt  (1  -  e  pt)  c;  e  _pt 


<a>c; 


;e'pt)dt=  —  6  (L17> 

p  rrm 


If  the  form  of  this  equation  is  compared  with  the  form  of  Eq.  (1.  3).  with  w(t)  -  lj, 


it  is  clear  that 


- ^-t 

4>k(t)  =  (_1)  / -g—  £  ( 

v  k 


l-e-pt)"^/k(a,  c;  e"pt) 


k  =  0,  1,  2,  .  .  . 


which  is  a  recursive  equation  for  the  elements  <j>k(t)  in  the  time-domain. 

Starting  with  the  recursion  equation  relatingj^k  +  ^  (a,  cjx)^^  (a,,  c  ;  x) 
andj?^.  x  (a,  c;x)  given  in  Section  10.  8  of  Ref.  (10)  one  is  able  to  derive  a  similar 
equation  for  the  elements  <i>k+|(t)>  <|>k(t),  and  <j>k  ^  (t)  . 

2  (k  +  l)(k  +  a  +  c  +  l),(2k  +  a  +  CyKk  +  1  +k  +  x  (t)  = 

-(2k  +  a  +  c  +  1)  [ (2k  +  a  +  c)  (2k  +  a  +  c  +  2)  (2  e  pt~l)  +  a^  -  c^ 


4>k  (t)  -  2  (k  +  a)  (  k  +  c)  (2k  +  a  +  c  h  2)\/kk-l 


(1.  18a) 


This  equation  might  prove  to  be  useful  in  a  computer  simulation  of  the  set  <j)k(t).  If, 
on  the  other  hand,  the  (k  -h  l)th  element  (j>k  ^(t)  is  to  be  found  via  manual  calculations 
then  it  is  usually  easier  to  find  it  directly  from  Eq,  (1.  18), merely  replacing  k  by  k  +  1 
in  that  equation. 

One  obvious  advantage  of  determining  the  elements  4>k  (t)  from  Eq.  (1.18) 


*  Strictly  speaking,  when  one  compares  Eq.  (1.  13)  with  Eq.  (1.  17)  he  can  only 
derive  a  proportionality  relationship  between  the  (*-)  and  the  terms  in  Eq.  (1.  17). 
The  constant  (-l)k  is  the  proportionality  factor. 
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is  that  it  has  completely  removed  the  difficulties  inherent  in  the  orthonormalization 
of  the  ^(t).  Essentially,  this  was  accomplished  by  introducing  the  well-defined 
Jacobi  Polynomials  in  whose  definition,  Eq.  (1,12),  the  orthonormalization  has  already 
been  carried  out.  One  is,  therefore,  able  to  express  an  unknown  set  of  orthonormal 
functions  in  terms  of  a  well-known  set  of  orthonormal  functions,  and,  in  so  doing  he 
has  eliminated  a  lot  of  the  algebraic  tedium  that  is  usually  a  part  of  an  orthonormali¬ 
zation  procedure. 

In  the  following  section  some  of  the  properties  of  the  (j>,  (t),  in  Eq.  (1.18), 
will  be  studied  in  order  to  throw  more  light  on  the  significance  of  these  functions. 
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1.  4  The  Nature  of  the  ^  (t)  . 

This  section  is  begun  with  a  theorem  which  states  the  most  significant 
property  of  the  functions  <|>k(t)  . 

Theorem  1.  The  asympt.otic-order  of  $k(s),  the  Laplace  Transform  of  4>k(t),  is 
a.  -  c  £t“C 

— +  1  for  all  k,  provided  that  — j—  is  either  a  positive  integer  or  zero. 


Proof:  — 

-  r  1  k  /  la  T 

Consider  =  (-1)./  -  <|>k  ^  [the  subscript  N  denotes  a  normal¬ 

ized  version  of  <j>,(t)l  as  the  product  of  two  functions  h(t)  and  g (t )  where  h(t)  = 
a-c  -I 

(1  -  e  "pt)  ~2~  and  g(t)  =  e  1  jFk  (a.  c;  e  _pt)  . 

The  1'  th  derivative  of  [4>k(t)]  N  with  respect  to  t,  <t>k  ^  ^  (t)  N  .  can  then  be  expressed 
in  terms  of  h(t),  g  (t ),  and  their  derivatives  by  means  of  the  Liebnitz  differentiation 
formula, 


=  >]  N  =  t 


r  1  (f  -  r ) ! 


h(*-r)(t)g(r>(t) 


from  which  one  sees  that 


^k(1>(t)N  =  h(1)(t)g(t)+h(t)g(1)(t) 


,k(Z)(t)N  =  h(2)  (t)  g  (t)  +  2h(1)  (t)  g(1)  (t)  +h  (t)  g(2)  (t) 


>{pr  ‘  11  (t)  N  =  h  (T"  "  1}  (t)  g  (t)  +  .  .  .  +  h  (t)  g^  •  1}(t)  (1.20) 


(t)  B  (t)  +  .  .  .  +  h  (t)  glT'( t) 


provided  that  is  a  positive  integer. 

*  Henceforth,  when  the  functions  c|>,  (t)  are  referred  to,  they  are  taken  to  be 
synonomous  with  the  set  defined  in,  Eq.  (1.18),  unless  otherwise  stated. 

Choosing  integer  or  zero  values  for  —  ensures  one  of  a  finite  series  in 

e  ”pt  for  <j>k(t). 
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Substituting  the  expressions  for  h(t)  and  g(t)  into  these  equations  and  setting 
t  =  0  one  can  easily  show  that 


K(1)  (°+> 


+k2)  (o+) 


N 


N 


=  0 


►ff-1*  (0+) 


N 


=  0 


(0+) 


N 


*  0 


(1.  21) 


It  is  also  true  that 


1 


4>k  (o+) 


N 


=  0  .  Next.one  appeals  to  the  Initial  Value  Theorem 


from  Laplace  Transform  Theory  which  states  that 

* 


4V  <0+> 


N 


lim  s  (s) 

s-voo  '  ' 


f 

> 

4>k(1)  (0+)l 

j 

..  =  lim  s 

N  s— *-oo  J 

s$  (s)- 

Nk 

<t>k  (0+) 

N  " 

. 

V. 

J 

age# 


a-c 


a-c  a-c 

<  ~TT-1  .  ,  >  ~2T 

-  lim  sis  $  ( s )  -  s 


—  tiill 

N  s  —  «) 


K  <0+>l 


<^-2V) 


N 


N  "  1 


(1.22) 


^  ’■s  t^e  Laplace  Transform  of  the  k1  th  normalized  element  4>-^ ( t  jJ . 

Due  to  the  continuity  of  the  £<l>kU)jj|  and  their  ~2~  ~  2  derivatives  at  the  origin, 

the  0  notation  in  all  of  the  derivative  transforms  has  been  replaced  by  the 
0+  notation. 


19 


Substituting  Eqs.  (1.  21)  into  these  equations  one  can  show  that,  at  most 

a-c 

lim  s  (s)  =  0  (1.23) 

s  —  oo  x\ 

cl"  C 

which  implies  that  the  degree  of  the  denominator  of  3?^  (s)  must  be  exactly  — +  1 

larger  than’the  degree  of  its  numerator.  It  has,  therefore,  been  proven  that,  for 
positive  integral  values  of  Jtl2-  ,  A.  O.  (' \  =  +  1  •  It  is  quite  obvious  that 

/  \  k> 

for  a^c  =  1,  2,  .  .  .  ,  f ,  A.  O.  /  $N  j  =  2,  3,  ...  I  +  1.  To  complete  the  pic¬ 
ture  let  a~c  =  0.  From  the  asymptotic-order  equation,  one  sees  that  this  is  the 
unity  asymptotic-order  case.  That  this  is  correct  can  easily  be  seen  by  setting 

— 2~  =  0  in  the  formula  for  the  (t)j  ^ 

/ 

In  order  to  obtain  a  simple  visual  interpretation  of  this  theorem,  the  results 
were  plotted  in  Figure  1.  3.1.  From  this  figure  one  sees  that  after  the  asymptotic 
order  is  specified  he  is  still  free  to  choose  either  a  or  c.  Note  also  that  the  results 
of  this  theorem  in  no  way  violate  the  earlier  constraints  on  a  and  cj^Eq.  (1.  14)j  which 
are  shown  by  dashed  lines  on  this  figure. 

The  true  significance  of  our  recursive  equation  for  the  4>k(t)  is  now  clear.  By 
properly  choosing  a  and  c  one  can  generate  sets  of  orthonormal  exponentials  whose 
Laplace  Transforms  are  of  any  asymptotic -order  whatsoever,  without  having  to  go 
through  the  usual  orthonormaliza.tion  procedures  . 

i 

Unfortunately,  however,  there  is  a  severe  restriction  on  the  pole  locations 
of  the  VS>-  "  -  they  can  only  be  equally  spaced.  This  will  be  proven  in  the  follow¬ 
ing  theorem. 

Theorem  2.  The  poles  of  3^.  (s)  are  located  along  the  negative-real  axis  in  the  s-do- 
main  at  -  (q  +—  )  p,  where  0  <  q  <  A.  O.  (3^)  +  k  -  1  and  is  integral.  These  poles 
are  equally  spaced,  p  units  apart. 

Before  the  proof  of  this  theorem  is  presented,  it  will  be  instructive  to  illustrate 
the  application  of  the  theorem  by  means  of  an  example. 
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f'gure  1.3>1 

(shaded)  from 


valid 


regions 


WRI-19078 
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Example 

For  A.  O,  ($k)  =  3  the  poles  of  ^(s)  are  located  at  -  (q  +  -^-)p,  where 

0  <  q  <  k  +  2;  thus,  the  poles  of  $q(s)  are  located  at  -  ~  p  ,  -  (  1  +  ~  )  p,  and 

-  (2  +  )  p  while  the  poles  of  (s)  are  located  at  -  p,  -  (  1  +  -£-)p, 

-  (  2  +  )  p  ,  and  -  (3  +  )  p. 

Proof: 

Writing  4>k(t)  as 

\  1  hk(t) 

v  k 

where 

a-c 

hk(t)=  U-e'pt)^~^k  (a,  c;e-pt) 


(1.  24) 


(1.  25) 


it  is  quite  simple  to  show__b-g  expanding  h^t)  that  it  contains  the  terms  1,  e  ~pt,  e  "2pt, 

•  •  .  i  e  k‘pt  \~T~  +  ,  This  means  that  Hk  (s)  will  have  all  of  its 

poles  situated  along  the  negative-real  axis  (including  the  origin)  of  the  s-plane  at 

0,-p,  -2p,  .  .  -  kp, . .  -  (k  +  -?_£_)  p;  or  alternatively,  one  can  state  that 

the  poles  of  Hk(s)  are  located  at  -  (qp)  where  0  <  q  <  k  +  — - —  and  is  integral. 

Taking  the  Laplace  Transform  of  Eq.  (1.  24),  one  is  able  to  conclude,  in  a  rather 
straight  forward  manner,  that  the  poles  of  $,  (s)  are  located  along  the  negative -real 
axis  of  the  s-plane  at  -  (q  +  —  )  p  where  0  <  q  <  k  +  — —  and  is  integral;  but  by 
Theorem  l,  the  range  of  values  q  may  take  can  be  written  as  0  <  q  <  A.  O.  (^.)  +  k  -  l. 
That  the  pole  spacing  is  p  is  obvious  from  the  location  of  the  poles  of  Hk(s)  which 
have  been  enumerated  in  detail. 

If  one  does  not  wish  to  use  a  set  of  evenly- spaced  poles  as  the  basis  for  his 
approximation  then,  of  course,  the  orthonormalization  procedure  must  be  carried  out 
anew  every  time  a  different  set  of  poles  is  used.  It  has  been  shown  that  this  becomes 
more  tedious  to  accomplish  the  larger  A.  O.  (5?k)  becomes.  The  only  exception  to 
these  last  statements  occurs  when  A.  O..  ($k)  =  1,  for  in  this  case  one  can  fall  back 
upon  Kautz1  s  recursive  equation,  (1.  8),  which  is  in  a  form  that  is  independent  of  the 
spacing s  of  the  o-k  . 

Generally  speaking,  one  has  a  great  deal  of  latitude  in  the  choice  of  the  ak  , 
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the  only  restriction  having  to  do  with  the  completeness  of  the  set  cj>,  (t).  The  work  of 

24  19  6  * 

Reiss  ,  Leight  ,  and  Brown  seems  to  indicate,  however,  that  a  geometric  pole 

spacing  may  be  the  optimum  one  to  choose.  Unfortunately,  their  conclusions  are  based 

upon  the  identification  of  such  a  simple  plant  (the  impulse  response  of  the  plant  is 
—  m  t 

e  )  that  one  questions  the  extension  of  their  results  to  more  complicated  situations. 

At  the  present  time,  no  other  literature  is  available  on  the  topic  of  optimum  pole  loca¬ 
tions  (as  far  as  the  author  knows)  for  the  approximations  of  processes  having  more  than 
a  single  pole;  thus,  it  is  not  possible  to  arrive  at  a  final  conclusion  about  the  optimum 
locations  of  the  .  If  one  should  decide  to  choose  an  equally  spaced  set  of  as  the 
poles  of  his  approximation,  then,  of  course,  the  theory  and  methods  developed  in  this 
chapter  and  the  following  two  chapters  would  be  directly  applicable.  If,  on  the  other 
hand,  a  set  of  non-equally  spaced  were  chosen,  then,  based  upon  the  asymptotics- 
order  of  the  approximation  and  the  location  of  the  ,  the  approximants  cj>,  (t)  could  be 
constructed  via  Eq.  (1.  3).  Naturally,  this  procedure  would  have  to  be  repeated  in  its 
entirety  for  every  different  set  of  a  . 

Let  us  remark,  at  this  point,  that  two  ways  for  constructing  the  functions  <t>k(t) 
whose  asymptotic-order  is  unity  and  whose  poles  are  evenly  spaced  have  been  presented 
-  -  -  Kautz'  s  equation  in  the  s -domain  and  the  recurrence  equation,  (1.  18),  in  the  time - 
domain.  It  would  be  reassuring  for  us  to  know  that  both  results  are  equivalent. 


Before  stating  and  proving  that  this  is  so,  the  following  notation,  which  will  be 

used  in  the  statement  and  proof  of  the  theorem  below,  is  introduced:  ch ,  (t)  and 

K  K 

J.  (t)  correspond  to  the  orthonormal  exponential  approximants  given  in  Equations  (1.18) 

rk  i 


Jacobi. Polynomial  representation  (J)  hand  (1.8)  |  Kautz'  s  representation  (K)  T ,  respec- 
-  _  j  J  ,  t  L  -PC  J 

lively,  (p^  (s)  is  the  Laplace  transform  of  (t)  and  Cf^  (s)  is  the  Laplace  transform 


of  c (t) 


Theorem  3.  (Uniqueness  Theorem) 


,  J 

1 

K 

<fc  (t). 

^ 

<J)  (s) 

k 

(a  =  c 

^ ^ 

k 

ak  =  (k+  T)p 

*  See  Appendix  A  for  a  discussion  of  "completeness"  and  its  affects  on  choosing 
the  sets  of  . 
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i  K  ^ 

provided  C p  ^  (t)  does  not  contain  any  null  functions. 

Tk  ^  *  (k  +  ®  )p 

The  constraint  a  =  c  on  the  <i,  J  ( t)  set  is  a  direct  consequence  of  Theorem  1,  while 

!/•  ^  Q 

constraining  the  poles  of  theCjpk { s )  set  to  be  equally  spaced  at  -  (k  +  —  )p  is  a  direct 
consequence  of  theorem  2. 

The  method  used  in  proving  the  theorem  is  a  simple  one:  first,  it  shall  be  shown 
that  (s)|  =  ( s )  I  c  ;  the  converse  will  then  follow. 


;  the  converse  will  then  follow. 


ak=  (k  +  T-)p 


Proof: 


For  a  =  c,  Eq.  (1.  18)  becomes 

j—  „  cPt 

^kJ(t,|a=  c  =  €  ^  Tw  (c>  c=  e'Pt> 


(1.27) 


where,  from  Eqs.  (1,12)  and  (1.15) 


^  *  <«■ « > « -pt>  *  1 .  <-»*  0)  mrirm  c  '<p'  "• 2BI 


k!  r(c) 
r(c+k)v€TTR 


(1.  29) 


Substituting  these  last  two  equations  into  Eq.  (1.  27)  and  taking  its  Laplace  transform 
one  finds  that 


<£kJ(s) 


=  Z  (-1)" 

a=  c  f  =  0 


/p(c+2k)  r(c+k  +  l) 
a i  (  k  - 1)\  (c  +  t ) 


[s  +(t  + 


(1.  30) 


One  must  now  demonstrate  the  equivalence  of  Eqs.  (1.  8)  and  (1.  30).  This  will  be  done 
by  means  of  an  inductive  type  argument.  In  particular,  when  k  =  r 


<bK  (s>  = 


(s  -  ao) - (s  -  ar_1  ) 


r  (s  +  a  )(s  +  a  )  .  .  .  (s+a  ) 
o  1  r 


$/<»>■  =  l  (-1)1 

a  =  c  i  -  0 


nr+lTj  r  (c  +  r  +  i  ) 


I  lr  -  .t )  i  1  i c 


[s  +  (f  f  4>P] 


(1.32) 


*  A  "null  function11  is  a  function  whose  area,  in  the  range  from  U~  to  oo,  is  zero  . 
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Equation  (1.  31)  can  now  be  developed  into  the  partial  fraction  expansion 


<£rK  (b) 


s  +a 


s  +  a. 


‘r-1 


s  +  a 


r-1 


s  +  a 


(1.  33) 


This  equation  shall  be  compared  with  Eq.  (1.32)  verifying  the  equality  of  the  coefficients 
V  ^  .  and  7^  and  their  respective  counterparts  in  Eq.  (1.  32)  under  the  condition  im¬ 
posed  by  the  theorem,  that  a  =  (r  +  )p.  If  this  is  so  then  the  (J>  ^  (s  )| 


K 

merely  the  partial  fraction  expansions  of  the  (s)| 


y  (the  residue  of  the  zeroth  pole) 


“  =  (r  +  y  )£ 


From  Eqs.  (1.  31  )  and  (1.  33)  it  can  be  shown  easily  that 

(2  a  )  (a  +  a  )  .  . .  (a  +  a  ) 
o'  o  1'  '  o  r-1' 


yQ  =  (-1  )By2a 
which  reduces  to 


(a  -  a  )(a,  -  a  )  ...  (a  -  a  ) 
1  o'  2  o  r  o 


(1.  34) 


v0  -  (-1)ry/2P  (r  +  -j- )  TTTI^r  (L35) 

when  ar  =  (r  +  -g-  )p  is  substituted  into  Eq.  (1.  34). 

To  find  the  corresponding  value  of  y  from  Eq.  (1.  32)  r  is  set  equal  to  zero. 

0  1 

Doing  this  and  comparing  the  coefficient  of  the  -  term  to  Eq.  (1.  35)  one  con- 

8  +  ~Z~  P 

eludes  that  they  are  the  same. 


2.  j  £the  residue  of  the  (r  -  l)th  terirfj 

Proceeding  in  exactly  the  same  fashion  as  in  the  preceding  case,  it  is  noted 
that  the  residue  y^  ^  in  Eq.  (1.  33)  is 


V 


r-1 


(ao  +  Vl)(al  4  Qr-1>  •  •  ’  (Zar-l  > _ r 

K  '  ar-lHal-Qr-l)---  (ar-2  -ar-l)(ar”:  Vl' 


(1.  36) 


which  reduces  to 


vr-i  = 


T(c  +  2  r-1) 
(r-1)  1  T(c  +  r-1) 


(1.  37) 


* 


*  Great  care  must  be  taken  when  factoring  (-1) 
of  Eq.  (1.  36)after  a  has  been  replaced  by  (r  + 
factored  out. 


out  of  the  terms  in  the  denominator 
£.)p.  In  this  case  (-l)r~^ 


was 
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This  Co'  responds  exactly  with  the  residue  of  the  pole  at 

s  =  -a  j  =  -(  t  -  1  +  )p  in  Eq.  (1.  32),  which  can  be  found  merely  by  substituting 
k  =  r  -  1  into  that  equation 

3.  yr  (the  residue  of  the  rth  term). 

Finally,  it  can  be  shown  that  the  residue  y  in  Eq.  (1.  33)  becomes,  after 
replacing  by  (r  +  ^  )p  , 


=  /2n  (f  +  -  )  r<  c  +  III 

V  P  1  +  2  '  r  1  r(c  +  r ) 


(1.  38) 


which,  once  again,  can  be  shown  to  correspond  exactly  with  the  residue  of  the  pole  at 
s  =  -  =  ■  (r  4  ^  )  p  in  Eq.  (1.  32) 


The  first  part  of  the  theorem  has  now  been  proven,  that  is,  it  has  been  demon¬ 
strated  that 


d>  J(t) 

rk 


>  k 


c£K  (B) 


ak  = (k  + 1  >  p 


(1.  39) 


since  it  has  just  been  shown  that 


J 

$k  (s) 


=  ■t’kK  (•> 


ak  =  (k  +  2  >  P 


(1.  40) 


That 


,  K 

^\r  (®) 


Qk  =  (k  +  I  )P 


(t) 


k 


(1.  41) 


follows  at  once  from  Eq.  (1.  40)  and  the  uniqueness  theorem  from  Laplace  Transform 
27 

Theory  which  states:  "Two  functions  of  time  having  the  same  Laplace  Transform  are 
equal  almost  everywhere  in  the  range  from  t  =  0  to  t  =  oo  differing  at  most  by  a 
null  function"  .  Since  null  functions  have  been  excluded  from  <py_  (t)| 
one  can  be  assured  that  Eq.  (1.  41)  is  true.  This  completes  the  proof. 


=  (k  +  j  )p 


The  significance  of  this  theorem  should  not  be  underestimated.  If,  for  example, 
the  inverse  were  true  then  the  statements  made  on  page  8'  (in  connection  with  the  Gram- 
Schmidt  Procedure),  regarding  the  uniqueness  of  an  orthonormal  set  would  be  violated. 
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There,  it  was  pointed  out  that  the  uniqueness  of  an  orthonormal  set  <j)^  (t ) ,  formed 
from  a  collection  of  functions  g^  (t)  depends  solely  upon  the  linear  independence  of 
the  elements  (t).  Since  the  set  of  elements  in  both  the  Kau'tz  expression,  Eq.  (1.  8), 
and  Eq.  (1.  18}  are  identically  the  same  (under  the  conditions  of  this  theorem),  that  is, 
g^  (t)  e{  e  "(*  +  2"  ^  f>t ^J-  ,  the  sets  must  be  identical.  It  has  just  been  proven  that 
they  are  indeed  equal. 

This  section  is  concluded  with  an  example  illustrating  the  results  of  Theorems 

1  and  2. 

Example:  Special  Sets  of  Functions  (t). 

It  has  been  shown  in  Section  1.  2  that  the  Gegenbauer  and  Legendre  polynomials 
are  special  cases  of  the  more  general  Jacobi  Polynomials  (Table  1.  2.  1).  In  this  exam¬ 
ple  the  relationships  existing  between  the  orthonormal  exponential  approximants  iE{t) 
and  the  Gegenbauer  and  Legendre  Polynomials  are  summarized.  This  summary  serves 
to  relate  the  Gegenbauer  and  Legendre  Polynomial  approximations  of  a  function,  f  (t), 
to  the  exponential  approximations  of  f  (t).  Table  1.  4.  1  presents  the  results  and  is 
self-explanatory.  Figure  1.  4.1  compares  the  asymptotic-order  behavior  of  the  Gegen¬ 
bauer  and  Legendre  sets  with  the  asymptotic -order  behavior  of  the  Jacobi  set.  Essen¬ 
tially,  it  is  a  reproduction  of  Fig.  1.  3.  1  upon  which  the  asymptotic-order  relationships 
for  the  Gegenbauer  and  Legendre  sets  have  been  superimposed.  Note  that  the  asymp¬ 
totic  order  of  the  Legendre  set  is  fixed  at  unity,  while  for  the  Gegenbauer  set  it  may 
assume  any  integral  value;  however,  once  the  asymptotic  order  of  the  Gegenbauer  set 
is  specified,  a  and  c  are  both  fixed.  This  is  in  contrast  to  the  Jacobi  set  where  one 
is  still  free  to  choose  either  a  or  c. 

It  would  be  desirable  now  to  extend  all  of  the  results  presented  in  this  chapter 
to  the  case  of  a  weighting  function  which  is  much  more  general  than  the  uniform  weight¬ 
ing  function  used  in  this  chapter.  The  next  chapter  discusses  just  such  a  weighting 
function.  In  chapter  3  the  results  of  this  chapter  are  extended  with  the  aid  of  the  results 
presented  in  chapter  2. 


Refer  to  Table  1.  2.  1  for  the  relation  between  the  Jacobi  Polynomials 
this  set  of  polynomials. 
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Figure  1.4.  1.  Summary  of  Table  3,  indicating  the  locus  of  A.  O.  ($  ) 
for  the  Gegenbauer  and  Legendre  Sets  as  compared  to  the  more  k 
general  results  of  Theorem  1. 


MRM9079 
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CHAPTER  2.  GENERALIZED  WEIGHTING  FUNCTIONS  AND  THEIR  DESIGN 


2, 1 _ Why  a  Weighting  Function? 

The  unweighted  integral- squared  error  criterion  emphasizes  large  errors 
heavily  and  de-emphasizes  small  errors,  for  all  time  greater  than  zero.  This  is  due 
to  the  squaring  operation.  If  one  assumes  for  the  moment  that  w{t)  in  Eq.  (1.  1)  (re¬ 
peated  below)  is  unity,  as  was  done  throughout  Chapter  1, 


IE 


2 


/ 


w(t)  [f(t) 


(1.  1.  ) 


he  is  in  effect  stating  that  f&(t)  is  to  approximate  f(t)  closely  over  the  entire  range  of 

time  (0,  oo).  To  require  this  may,  in  many  cases  be  unnecessary,  impractical,  and 

even  undesirable.  For  example,  suppose  one  needs  only  to  obtain  a  close  fit  over  a 

finite  range  of  time.  Two  cases  of  this  are  shown  in  Fig.  2.1.1.  The  impulse  response 

»  in  Fig.  2.  1.  la  is  typical  of  systems  having  a  very  high  asymptotic-order.  Since  much 

of  the  important  information  is  concentrated  in  the  interval  (t,  ,  t7  )  it  seems  wise  to 

2.  & 

emphasize  this  region  in  the  IE  criterion.  The  only  way  one  can  introduce  a  time  de- 

2 

pendence  effect  into  the  IE  criterion  is  to  choose  a  weighting  function  dependent  upon 
time.  Choosing  the  weighting  function  shown  in  Fig.  2.1.1c.  gives  the  desired  effect; 

for,  the  product  of  this  weighting  function  and  the  error  function  f.  (t)  -  f  (t)  in  Eq. 

-i  f  al  |. 

(1.  1)1  tends  to  emphasize  the  error  in  the  interval  (t^  ,  t^  )  and  to  de-emphasize  it  out¬ 
side  of  the  interval. 

The  system  characterized  by  the  impulse  response  in  Fig.  2.1.1b  contains  a 
delay;  that  is,  for  an  input  applied  at  t  =  0  there  is  no  output  until  time  T.  To  empha¬ 
size  the  fact  that  the  response  is  actually  zero  in  the  time  interval  (0,  T)  one  might 
choose  a  weighting  function  of  the  form  shown  in  (d)  of  Fig.  2.  1.  1.  Once  again,  it  is  to 
be  noted  that  in  both  (a)  and  (b)  of  Fig.  2.  1.  1  the  emphasis  and  de -emphasis  of  the 
error  function  has  been  accomplished  by  means  of  a  time -dependent  weighting  function, 

>Je  # 

and  not  by  changing  the  limits  of  integration  in  Eq.  (1.  1). 


~f  By  convention,  the  term  "  unweighted1’  refers  to  the  case  where  wit)  is  independent 
of  time.  It  is  a  bit  misleading,  however,  since  the  prefix  un  -  would  seem  to  imply 
zero  weighting.  Perhaps  "uniformly  -  weighted"would  be  a  more  appropriate  choice 
of  terminology. 

=*=K  The  emphasis  of  the  time  interval  (tj  ,  t2)  in  Fig.  2.1.1(a)  and  the  de-emphasis  of 
the  interval  (0,  T)  in  Fig.  2.  1.  1  (b )  could  also  have  been  achieved  using  rectangular- 
pulse  weighting  functions.  A  rectangular  weighting  function,  unfortunately,  introduces 
considerable  analytical  difficulty.  This  is  further  discussed  in  Section  2.  4. 


Figure  2.1.1.  Impulse  responses  and  weighting  functions  useful  in  the 
identification  of  the  impulse  responses,  (a),  (b)  impulse  responses 
(c),  (d)  weighting  functions. 
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So  far,  it  has  been  indicated  how  one  might  choose  a  weighting  function  from 
the  viewpoint  of  obtaining  a  close  fit  between  f  (t)  and  f  (t)  .  In  many  cases,  one  is 
also  interested  in  using  the  identification,  f  (t),  in  a  frequency-domain  analysis.  If, 
in  particular,  high-frequency  effects  are  important,  then  one  must  weight  the  error 
function  quite  heavily  for  small  values  of  t  .  This  can  be  dedeuced  from  the  Initial- 
Value  Theorem: 

fa  (0+>  =  s1^  s  Fa  (b)  (2-1) 

On  the  other  hand,  if  it  is  the  low-frequency  effects  which  are  of  primary  con¬ 
cern,  then,  from  the  Final- Value  Theorem 

f  (oo)  =  lim  s  F  (s)  (2.2) 

a  s  —  o  a 

one  concludes  that  a  weighting  function  emphasizing  large  values  of  t  should  be  chosen. 

Heavy  weighting  of  small  values  of  time  is  also  very  important  in  the  identifi¬ 
cation  u»ed  in  adaptive  control  systems^’  where  one  is  primarily  concerned  with 

characterizing  a  plant  as  quickly  as  possible  and  over  a  short  interval  of  time  (0,  T). 
This  has  been  done  in  the  past  by  choosing  an  exponential  weighting  function.  Increas¬ 
ing  the  amplitude  and  decreasing  the  time  constant  of  the  exponential  function  provides 

«J > 

the  desired  emphasis  in  the  interval  (0,  T)  . 

Weighting  functions  emphasizing  large  values  or  small  values  of  t  will  be  dis¬ 
cussed  at  greater  length  in  Chapter  4.  In  the  remaining  sections  of  this  chapter  weight¬ 
ing  functions  of  the  form  shown  in  Fig.  2.  0.  1  c  and  d  shall  be  studied  in  greater 
detail. 


■f  For  a  discussion  of  other  weighting  functions  that  might  prove  to  yield  far  superior 
results  in  the  Adaptive  Identification  problem  see  Chapter  5. 
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2.  2  w(t)  and  its  Properties 

In  this  section  some  properties  of  the  weighting  function  in  Eq.  (2.  3)  shall  be 
investigated. 

w(t)  =  c  "k°  kl  1  (l-e'klt)2  (2.3)* 

ko-  kl’  k2  >  0 

Typical  portraits  of  w(t)  appear  in  Fig.  2.  2.  1,  from  which  it  is  evident  that,  when 
is  zero,  w(t)  reduces  to  an  exponential  weight  function,  while,  when  both  k^  and  kQ 
are  zero,  w(t)  is  constant.  The  general  form  of  w(t)  appears  in  (d)  of  Fig.  2,  2.  1. 

It  has  a  single  maximum  at  time  t  max.  ’  where 


Depending  upon  the  choice  of  values  for  kQ,  k  ,  and  k^,  w(t)  may  be  made  very 
narrow  or  very  wide.  A  measure  of  the  width  of  w(t)  may  be  formulated  in  terms  of 
the  distance  between  the  two  inflection  points  of  w(t).  If  t^  and  t^  are  the  times  of  the 
first  and  second  inflection  points  respectively,  (see  Fig.  2.  2.  2)  then  AT,  the  distance 
between  these  inflection  points  is 


AT 


4  -  h 


(2.5) 


t^  and  t.,  are  found  to  be  the  two  solutions  of  the  equation 


d2  w(t) 
dt2 


=  0 


(2.6) 


and  are 


1,2 


2k2+2k  k.,  +  k,  +  /k,  (4k  +  4  k  k9  +  k7  )■' 

o _ o  2  2  -y  2  o _ o  2  2 

2  (  k  +k?)2 


(2.  7)' 


5  It  is  tacitly  assumed  throughout  the  remainder  of  the  dissertation  that  w(t)  is  ampli- 
tude  normalized,  that  is,  its  amplitude  is  multiplied  by  unity.  Multiplying  w(t)  by 
a  constant  does  not  change  any  of  the  results  presented  in  this  chapter. 

**  To  calculate  t^  (t.,)  use  the  positive  (negative)  square  root  in  the  numerator  of 
this  equation. 
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This  equation  and  Eq.  (2.  4),  for  t  max  .  will  be  very  useful  in  the  design  procedure 
developed  in  the  following  section  for  selecting  the  constants  kQ,  k^,  and  . 


*  When  k ^  =  0,  AT  has  no  meaning  since  w(t)  =  e  °  1  has  n’>  inflection  points. 

Under  this  condition  AT  =  0  in  Eq.  (2.  8)  which  is  meaningless. 
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2.  3  The  Design  of  w(t) 

In  this  section,  a  method  for  determining  the  constants  kQ,  k^,  and  k_,  in 
Eq.  (2.  3),  from  a  given  set  of  specifications  on  w(t),  will  be  discussed.  It  is  by  no 
means  the  only  method  which  may  be  devised,  but,  rather,  is  one  which  sheds  a  great 
deal  of  light  onto  the  effects  which  these  constants  have  on  the  shape  of  w(t).  An  alter¬ 
nate  procedure  which  is  more  germane  to  the  theory  presented  in  Chapter  3  will  be 
discussed  in  that  chapter;  however,  most  of  the  results  of  this  section  will  be  directly 
applicable  to  that  method  also. 

Three  constants  are  to  be  determined;  therefore,  three  independent  specifi- 
cations  on  w(t)  must  be  given.  The  three  conditions  listed  below  are  only  one  set  out  of 
many  possible  sets;  however,  they  are  a  particularly  advantageous  set  in  that  they  en¬ 
able  one  to  readily  control  the  shape  of  w(t). 

1.  The  initial  behavior  of  w(t)  may  be  accounted  for  by  pre-specifying  k^; 
since,  quite  obviously,  from  the  form  of  w(t),  the  number  of  derivatives  of  w(t)  which 
are  zero  at  t  =  0  depends  solely  upon  its  value,  k,  also  controls  the  width,  AT,  of 

c  >r 

w(t)  as  shall  be  shown.  The  pre  -  specified  value  of  k.,  shall  be  designated  as  k ^ 

s 

where  in  general  >  0 
s  _ 

2.  After  a  region  of  maximum  emphasis  of  f (t )  has  been  decided  upon,  trnax 
is  chosen  so  as  to  coincide  with  the  center  of  this  region.  By  locating  tmax  in  this 
manner,  it  is  possible  to  design  w(t)  in  such  a  manner  that  it  emphasizes  the  desired 
region  of  maximum  emphasis  of  f(t).  The  pre-specified  time  t  max  shall  be  desig¬ 
nated  t  . 

s 

3.  It  shall  be  desirable  to  have  the  amplitude  of  w(t)  become  approximately 
zero  within  some  pre-specified  time  interval,  say  4  Tg  .  Naturally,  4  Tg  must  be 
chosen  such  that  4t.  >  ts  .  This  condition  prevents  one  from  attempting  to  design  a 

s  i 

weighting  function  where,  for  example,  t  =  jq-  second  and  tmax^  =  1  second. 

These  3  conditions-can  be  expressed  in  terms  of  ko<  k^  and  k^  as  follows: 


>1“  The  subscript  s  stands  for  "specified  a  priori"  . 

Choosing  integer  values  for  usually  results  in  numerical  simplifications  and 

also  enables  one  to  correlate  the  initial  behavior  of  w(t)  in  the  time-domain  to  the 
asymptotic -order  of  W(s)  in  the  s-domain. 
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(2.  9) 

(2.10) 


(2.  11) 


That  the  actual  process  of  determining  from  Eq.  (2.12),  by  trial  and  error, 
is  a  rapidly  converging  one  can  best  be  illustrated  by  means  of  an  example. 

Example  1. 

The  impulse  response  of  the  overdamped  process  shown  in  Fig.  2.  3.1  is  to  be 


Figure  2.  3.1.  Impulse  response  of  an  overdamped 
process. 
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approximated  in  an  integral-squared  sense,  such  that  the  approximation  is  particularly 

accurate  for  0.  25  <  t  <  0.  75  sec.  As  the  first  step  in  the  approximation  procedure 

(to  be  outlined  in  Chapter  3)  a  weighting  function  must  be  designed. 

* 

1.  The  center  of  the  region  of  maximum  emphasis  of  f(t)  occurs  at  t  =  0.  50 
sec;  thus,  based  upon  the  discussion  on  page  35  t  is  chosen  to  be  l/2  sec.  At  the 
moment,  there  is  no  basis  for  the  choice  of  one  value  of  over  another,  however,  such 
a  basis  will  be  established  shortly..  Here  k^  is  arbitrarily  chosen  to  be  two,  i.  e.  , 

k^  =  2.  In  order  to  make  sure  that  w(t)  emphasizes  the  entire  region  0.  25  <  t  <  0.  75 
s 

heavily,  as  desired,  r  is  chosen  to  be  0.  3  second. 


2. 


Ik, 


-  1 


076 


(2.  12  a) 


Table  2.  3.  1.  Calculation  of  k^ 


Assumed  Value 

1  k 

7  K1 

€  *  -  1 

of  k^ 

0.  6 

1.  0 

1.  085 

0.  9 

0.  95  0 

0.  8 

0.  816 

0.  7 

0.  700 

3.  With  kj  =  0.  7  and  t  =  0.  3,  kQ,  in  TDq.  (2.  13),  is  found  to  be  4.  76. 
Summarizing,  one  can  easily  verify  that  the  weighting  function  w(t)  is 


w(t) 


-3,  33t  ,,  -0.  7tj2 

■t  (l  -  e  / 


(2.14) 


*  These  numbers  correspond  to  the  numerical  designations  assigned  to  the  steps  in 
the  design  procedure  on  page/  36. 
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One  now  may  pose  the  following  question:  "Having  designed  a  weighting  function 
via  the  trial  and  error  procedure  outlined  above,  is  there  any  shortcut  available  for 
designing  other  weighting  functions  based  upon  the  information  available  from  the 
design  of  the  first  one?"  .  The  following  theorem  presents  just  such  a  shortcut. 

Before  stating  and  proving  the  theorem  some  new  nomenclature  will  be  intro¬ 
duced.  Associated  with  a  weighting  function  w  (t),  where  the  unity  superscript  indi¬ 
cates  that  this  function  was  actually  designed  by  means  of  the  trial  and  error  proce¬ 
dure,  are  the  following  constants:  the  pre- specified  ,  t^  and  and  the  calcu- 

11  s 

lated  kQ  and  .  Similarily,  associated  with  the  j'  th.  weighting  function  w^  (t)  are 

the  constants  ki  ,  t-*  ,  t1'  ,  k^  and  . 

2  max.  o  1 

Theorem  4.  Given  ki  ,  t1^  =  t^  and  k|  =  kj  ,  then 


and 


Figure  2.  o.  2.  Illustration  of  Theorem  4. 


*  This  theorem  can  also  be  used  out  of  the  context  of  the  design  procedure  presented 
in  this  section.  Such  an  application  is  discussed  in  Chapter  3,  Section  3.  2. 
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A  graphical  interpretation  of  this  theorem  is  given  in  Fig.  2.  3.  2.  One  sees, 

from  this  figure,  that  the  theorem  enables  him  to  construct  a  family  of  weighting 

functions,  each  having  its  maximum  at  the  same  value  of  time,  and,  each  having  a 

different  value  of  k,  .  It  was  pointed  out,  in  Example  1  of  this  section,  that,  while 
2s 

there  exists  a  practical  basis  for  the  pre  -  specification  of  tmax  ,  there  does  not  yet 

exist  a  practical  basis  for  the  way  in  which  to  pre- specify  k  .  In  Example  1  a  weight 

ing  function  was  designed  for  a  specific  value  of  t  and  an  arbitrarily  chosen  value 

of  k^.  Theorem  4  now  enables  one  to  rapidly  determine  the  effect  of  an  increase  or 

decrease  in  k  on  the  shape  of  w(t),  for  a  specific  value  of  t 

l.  max. 

The  seemingly  stringent  requirement  that  all  of  the  k^  s  be  identical  for  all  of 
the  vr'(t)1  s  actually  is  a  direct  consequence  of  the  general  theory  presented  in  Chapter 
3.  There  it  will  be  shown  that  this  constant  equals  the  pole  spacing  of  the  elements 
^(s)  and  that  this  spacing  is  usually  fixed  a  priori;  hence,  for  a  given  pole  spacing,  a 
family  of  weighting  functions  may  be  constructed,  but  they  must  all  have  the  property 


The  proof  of  theorem  4  follows. 


Proof: 


From  Eq.  (2.  10)  and  the  given  information  one  finds 


!> 

e  1  s  -  1 


and 


kJ  = 

o 


kj  t1 

€  1  S-1 


After  k^  is  divided  by  k^  one  is  able  to  conclude  that 
o  1  o 


v/hich  proves  the  first  part  of  the  theorem.  If  one  proceeds  to  substitute 


(2.17) 


(2.  18) 


(2.19) 


^ 

k,  kJ 
1  o 


(2.  20 
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Dividing  numerator  and  denominator  of  the  logarithmic  argument  in  Eq.  (2.  24)  by 

and  letting  become  very  large  it  is  easy  to  show,  by  means  of  limit  arguments, 

c  s  L  s 

that 

lim  ATJ  =  0 

k^-oo  (2.26) 

s 

In  a  similar  fashion  one  may  also  show  that  AT^  is  a  monotonically  decreasing 
function  of  ;  that  is  to  say,  increasing  k^  always  narrows  w^(t)  while  decreasing 

it  widens  wJ(t).  This  is  borne  out  in  the  following  example. 

Example  2. 

In  this  example  the  design  of  weighting  functions  based  upon  the  specifications 
given  in  Example  1  is  continued.  Here,  as  in  Example  1,  weighting,  functions  are  de¬ 
signed  such  that  tmax  =  0.  5  0  second.  The  effect  of  choosing  values  for  other  than, 
two,  in  the  design  of  these  weighting  functions  viaTheorem  4,  is  studied  in  detail. 

Table  2.  3.  2  summarizes  three  designs  and  their  properties.  w\t)  is  the  weight- 

2  3 

ing  function  designed  in  Example  1.  w  (t)  and  w  (t),  on  the  other  hand,  were  obtained 

directly  from  the  entries  in  the  first  row  of  Table  2.  3.  2  and  Eqs.  (2.  15)  and  (2. 16)  of 

2  3 

Theorem  4.  The  properties  of  w  (t)  and  w  (t)  are  listed  in  the  second  and  third  rows 

of  Table  2.  3.  2  respectively.  Figure  2.  3.  3  presents  a  graphical  summary  of  the  re- 
12  3 

suits.  For  clarity,  w  (t),  w  (t),  and  w  (t)  have  been  scaled  up  by  factors  of  100,  20, 

2 

and  2000  respectively.  Note  that  w  (t)  is  the  widest  function  and  that  this  corresponds 
to  the  unity  k,  case;  thus,  the  example  substantiates  the  theory.  If  the  width  of  the 
weighting  function  is  used  as  a  measure  of  the  time  of  maximum  emphasis  of  wJ(t),  then, 
based  upon  the  specification  stated  in  Example  1,  that  f(t)  is  to  be  approximated  most 
accurately  for  0.  25  <  t  <  0.  75  sec.  (see  Fig.  2.  3.  1),  and  the  widths  of  the  three 

~  ~  3 

weighting  functions  listed  in  Table  2.  3.  2,  one  concludes  that  w  (t)  is  the  most  satis¬ 
factory  design,  of  the  three  weighting  functions  listed. 
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Figure  2.  3.  3  A  comparison  of  the  three  weighting 
functions  listed  in  Table  2.  3.  2  . 
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-  k  k.  t/  -k,  t'N  ^ 

2.  4  Why  the  Weighting  Enaction  w(t)  =  €  °  \1  -  e _ /  ? 


Thus  far,  no  mention  has  been  made  of  the  reasons  for  choosing  the  particular 
weighting  function 


w(t) 


-k  k,  t 
o  1 


(2.  3) 


or  for  spending  so  much  time  discussing  its  properties,  and  a  procedure  for  design¬ 
ing  it  based  upon  these  properties.  What  makes  this  weighting  function  so  useful? 


It  has  already  been  indicated,  in  Section  2.1,  that,  many  times  one  is  merely 
concerned  with  the  problem  of  fitting  or  approximating  a  function  closely  over  a  closed 
time  interval,  (t.  ,  t  ).  If  this  be  the  case,  then  the  most  desirable  form  to  choose 

1  z 

for  w(t)  is  the  rectangular  gating  function  in  Figure  2.  4.  la  .  This  is  equivalent  to 

changing  the  domain  of  integration  in  Eqs.  (1.1),  (1.  3)  and  (1.  4),  from  the  interval 

(0)  oo)  to  the  interval  (t  ,  t-  )  .  Charging  these  limits  results  in  very  tedious  compu- 

1  z 

tations.  It  is  also  interesting  to  '-.ote  that  Kautz1  s  results  and  all  of  the  results  pre¬ 
sented  in  Chapter  1  are  useleso  in  this  case. 


Figure  2.  4.  1.  Weighting  functions  emphasizing  cne  interval  of  _  ^  jOtg 

time  (tj,  t2).  (a.)  Gating  function,  (b)  w(t)  =  e  k°  kl  4  [i  -  e  1  / 

approximating  the  gating  function. 


One  must  therefore  conclude  that  the  analytical  difficulties  encountered  when 
gating-type  weighting  functions  are  used  precludes  their  usefulness.  This  does  not 
mean  that  the  idea  of  a  gating  function  is  incorrect;  it  suggests,  rather,  that  one 
might  choose  a  weighting  function  approximating  the  gating  function  in  shape  -  -  - 
one  which  is  more  manageable  in  the  Eqs.  (1. 1),  (1.  3),  and  (1.  4)  than  the  gating  function 
is.  The  weighting  function  in  Eq.  (2.  3)  is  just  such  a  function.  That  this  is  so  is 
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amplified  in  Fig.  2.  4.  lb  where  the  gating  function 

-k  k,t  /  -k,t'N\<’2 


approximated  by  w(t)  =  e 


o  '1 


1  -  e 


“-I  (t  -  ti>  -  u  _i 


A  second  reason  for  choosing  w(t)  in  Eq.  (2.  3)  is  that  this  is  the  natural  choice 
to  make  if  the  results  of  Chapter  1  j^where  w(t)  was  unityj  are  to  be  extended  to  a 
more  general  weighting  function.  This  is  perhaps  the  more  important  of  the  two 
reasons  as  will  be  seen  in  the  next  chapter. 
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CHAPTER  3.  THE  ORTHONORMAL  EXPONENTIAL  SET  FOR 
EXPONENTIAL  WEIGHTING  FUNCTIONS 


3.  1 _ Introduction 

The  purpose  of  this  Chapter  is  to  extend  the  results  of  Chapter  1  to  the  cases 
of  exponential  weighting  functions.  This  is  accomplished  with  the  aid  of  the  theory 
presented  in  Chapter  2. 

Recall  that  the  elements,  ^(t),  of  an  orthonormal  set  satisfy  the  relationship 
00 

f  w(t)  <F  (t)  <(>.  (t)  dt  =  6.-  (3.1) 


and,  in  particular,  recall  that  if  the  <|>.  (t)  are  chosen  from  a  set  of  exponential  functions 
wherein  the  poles  of  the  4>^(s)  are  evenly  spaced  along  the  negative  -  real  axis  of  the 
s-plane,  Eq.  (3.  1)  can  be  written  in  terms  of  the  classical  Jacobi  Polynomials, 

$  m  (a,  c  ;  x),  given  by 


I 


e-Cpt  (1  - 


-pt. 


X 


(a,  c;  e  pt)<^.  (a,  c;  e  pt)  dt 


K. 

J  fi 

P  bij  (3.2) 


When  w(t)  =  1  in  Eq.  (3.  1)  it  is  shown  in  Chapter  1,  that 


V‘)  *  ‘-‘'"/tf 


e  1  (1 


e*pt) 


3- ^  (a,  c;  e  "pt) 


(3.3) 


This  was  obtained  by  comparing  Eqs.  (3.1)  and  (3.  2)  after  the  weighting  function 
(a-c) 

,  in  Eq.  (3.  2),  had  been  split  into  two  equal  portions 
(a-c ) ” 


6  'Cpt  (1  -  6  *pt) 


e  '  TT  1  (1  -  e  'pt)  Z 

.  ^  (a-c) 

-cpt  (1  _  e-pt) 

-Pd  ; 


;  the  two  equal  portions  of  the  weighting  function 
were  first  associated  with  the  factors  (a,  c;  e  pt)  and 


(a,  c;  e  p  )  in  Eq.  (3.  2),  before  the  comparison  of  Eqs.  (3.  1)  and  (3.  2)  was  made. 


If,  instead  of  splitting  the  entire  weighting  function  in  Eq.  (3.  2)  into  two  equal 

X  c  t  _  t  X2  (a-c) 

parts,  a  portion  of  the  weighting  function,  say  e  1  p  (1  -  e  *  )  ,  is  first 

removed  then,  upon  comparison  of  Eqs.  (3.  1)  and  (3.  2),  it  is  possible  to  conclude  that 


K  (f)  =  (-D 


-d-x,) 


£P  i 


T  IT1 


-pt 


(1-X7)(  ^c) 


/  (a,c;.e'pt)  (3.4) 


0,  1,  2, 
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(3.5) 


(3.  6) 


Equation  (3.  4  )  is  an  equation  for  the  elements  ^(t)  of  an  exponential  set  which  are 
orthonormal  with  respect  to  the  weighting  function  in  Eq.  (3.  6).  When  both  X^  and  X ^ 
are  equal  to  zero,,  Eq.  (3,  4)  reduces  to  Eq.  (3.3).  For  all  value  s  of  Xj  and  X  ^  .  as 
defined  in  Eq.  (3.  5),  w(t),.  in  Eq.  (3.  6),  corresponds  exactly  to  the.  weighting  function 


€ 


-  k  k. 
o  1 


discussed  in  the  previous  chapter,  provided 


k  -  X ,  c 
o  1 


k  =  p 


k2  k 2  (a'c )  J  * 

Thu6,  all  of  the  results  pertaining  to  the  properties,  and  to  the  design  of  e  °  x 

'  A  2 


1  I 

1  _  e  J  ,  apply  directly  to  w(t)  in  Eq.  (3.  6)  provided  the  transformations  in 
Eq.  (3.  7)  are  employed. 


Equations  (3.  4)  and  (3.  6)  form  the  basis  for  the  remaining  sections  of  this  chapter. 
First  the  properties  of  the  <t>^  (t)  shall  be  reviewed  in  the  light  of  the  more  general 
weighting  function,  Eq.  (3.  6).  Then  a  design  procedure  for  uniquely  determining  the 
constants  Xj,  X^>  c>  a>  and  p  in  Eqs.  (3.4)  and  (3.6)  shall  be  developed.  Following 
the  steps  of  this  procedure  it  will  be  straight  forward  to  construct  the  set  of  exponen¬ 
tials,  in  Eq.  (3.  4),  orthonormal  with  respect  to  the  weighting  function  in  Eq.  (3.  6). 
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3.  2  The  Nature  of  the  <j>^  (t)  , 

The  format  of  this  section  is  similar  to  that  of  Section  1.  3,  wherein  the  asymptotic- 
order  of  the  the  pole  spacing  of  the  ^(s),  and  the  conditions  under  which  Eq.  (1118) 

reduced  to  Kautz'  s  results,  Eq.  (1.  8),  were  investigated.  There  the  results  were 
stated  and  proved  in  the  form  of  three  theorems.  Here  the  corresponding  results  for 
the  more  general  set  of  elements  in  Eq.  (3.  4)  shall  merely  be  stated.  The  proofs  of 
these  statements  are  identical  to  those  of  their  special  counterparts  in  Section  1.  3, 
except  for  some  symbolic  changes  due  to  the  inclusion  of  the  more  general  weighting 
function,  Eq.  (3.  6). 

% 

Theorem  1G.  The  asymptotic-order  of  $^(s),  the  Laplace  Transform  of  <j>,  (t),  is 
(1  -  X.  ^)(  ~2~-)  +  1  for  all  k,  provided  that  (1  -  X^)(  -■g-1 )  is  a  positive  integer  or  zero. 

Theorem  2G.  The  poles  of  the  ^(s)  are  located  along  the  negative-real  axis  in  the 
s -domain  at  -  j^q  + -^  (  1  -  X^)jp  where  0  <  q  <  A.  O.  (S^.)  +  k  -  1,  and  is  integral. 

These  poles  are  spaced  p  units  apart. 

Table  3.  2.  1  summarizes  the  results  of  these  theorems.  The  weighting  functions 
listed  in  the  first  column  correspond  to  the  four  functions  sketched  in  Fig.  2.  2.  1. 

The  results  of  Theorem  1G  can  also  be  summarized  as  in  Fig.  1.  4. 1  if  a  and  c 

i  t  >!<  >!<>!« 

are  replaced  by  a  =  a  (1  -  X2)  and  c  =  c  (1  -  X2)  respectively  in  that  figure. 


Theorem  3G. 


(Uniqueness  Theorem) 


>!<  >!<>!<  >!< 

(3.  8) 


to  within  a  set  of  null  functions. 


*  The  11  G"  notation  indicates  that  this  is  the  general  form  of  the  corresponding  theorem 
presented  in  Section  1.  3. 

**  See  Appendix  B  for  a  more  extensive  discussion  of  the  pole  spacing  question. 

***  The  inequality  a  >  c  -  1  becomes  a'  >  c  1  -  (1  -  X  j  )  which  actually  is  a 
family  of  constraints  dependent  upon  X^.  When  X  -  =  °>  a'  >c'  -1  and  for  aH 
0  <X2  <1  this  line  moves  to  the  left  approaching  tne  line  a'  =  c'  as  X^ 
approaches  unity. 

*#*#  The  J  superscript  in  (t)  reJers  to  the  Jacobi  Polynomial  equation  for  4>,  (t), 

k  -n  K 

Eq.  (3.4).  The  B  superscript  in  (s),  on  the  other  hand,  refers  to  the  set  of  <5^  ( s) 
in  Eq.  (1.  9)  developed  by  Braun  ^  . 
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Table  3.  2.  1.  Summary  of  Theorems  1G  and  2G. 


X1 

X2 

w(t) 

A.  O.  (9>k) 

Pole  Locations 
of  $k  (s) 

0 

0 

1 

V  +1 

-(q+  §>P  M 

t  0 

0 

-  X  ^cpt 
e 

a-c  +1 

2 

- 

q  +  f  (i-xL) 

p 

0 

X2  *  0 

(a  -  c) 

( a~c\  , 

u_x2  kx/i'] 

-  (q  +  |)p 

0 

X2  4  0 

.  . 

(1"X2  )(tt)+1 

- 

q+  j  (i  -  Xj) 

p 

In  effect,  this  theorem  states  that  Eq.  (1.  9),  obtained  by  Braun  for  the  weight¬ 
ing  function  e  ~2bt  ,  is  identical  to  the  results  given  by  Eq.  (3.4),  provided,  of  course, 
it  is  understood  that  this  is  only  true  for  the  set  with  unity  asymptotic -order  and  evenly- 
spaced  poles  -  -  where  b  =  X  1 


2 
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Armstrong'  s  Example. 

2 

In  a  Letter  to  the  Editor  appearing  in  the  I.  R.  E.  Transactions  on  Circuit  Theory, 
Armstrong  compares  the  integrals 


/  e  "3t  (1  -  e  "Vm  (4*  3i  e  "*)  (4.  3;  e  "*>  dt  = 


n  •  F  r  ( 3 )] 


r(n  +  2) 


2  (2  +  n)  F(n  +  4)  T  (n  +  3) 


(3.  9) 


6 


mn 


and 


00 

f  e  _t  (  1  -  e  _t)  <|)n  (t)  dt 

*  o 


6 


mn 


(3.10) 


from  which  he  concludes  that  a  suitable  representation  for  the  elements 


<t>kU)  = 


(-1) 


(k  +  1)  (k  +  2)  (k  +  3) 


1/2 


<|>k  (t)  is 


(3.11) 


It  is  easy  to  show  from  Eqs.  (3.  1),  (3.  4),  (3.  6),  (3.  10),  and  (3.  11)  that  this 
example  is  the  special  case 

a  =  4,  c  =  3,  p  =  l,  K  2  =  1 ,  and  X  ^  =  -j  .  (3.12) 

It  is  interesting  to  note  that  by  choosing  X  ^  ”  i  Armstrong  has  constructed  a 

set  of  orthonormalized  exponentials  where  A.  O.  ($,  )  =  1.  This  set,  however,  is 

K  -t  -t 

orthonormal  with  respect  to  the  weighting  function  e  (  1  -  €  )  which  is  a  more 

4  22 

complicated  weighting  function  than  the  exponential  weight  Braun  ’  used.  Armstrong1  s 

weighting  function  emphasizes  a  region  of  time  in  the  vicinity  of  its  maximum,  which 

occurs  at  t  =  0.  693  second, 

max. 

From  Table  3.  2.  1  it  is  seen  that  the  poles  of  Armstrong1  s  set  occur  at  -  (q  +  1), 

0  <  q  <  k  >  the  first  pole,  ,  being  at  -  1. 
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3.  3.  A  Design  Procedure  for  Constructing  the  . 

For  convenience,  Eq.  (3.4),  for  the  elements  <j>^(t),  is  repeated  below. 


-U-X,) 


d-x2)( 


(a,  c;  e 


In  order  to  carry  out  the  numerical  computations  indicated  in  Eq.  (3.  4)  one  must  some¬ 
how  choose  values  for  the  constants  a,  c,  p,  X.  ^  and  X^  •  In  this  section,  one  procedure 
for  determining  these  constants,  from  a  set  of  specifications  on  both  w(t),  in  Eq.  (3.  6), 
and  (F  (t),  in  Eq.  (3.  4),  is  developed. 

(a)  First-pole  location. 

From  the  pole-location  theorem,  Theorem  2G,  it  can  be  shown  that  the  first 
pole,  ,  of  (s)  will  lie  along  the  negative-real  axis  of  the  s-plane  at 


ao  =  7  (1  -  Kl>P  (3‘13) 

It  should  be  possible  to  roughly  locate  this  pole  from  an  inspection  of  the  portrait  of 
f  (t).  As  an  example,  suppose  that  f  (t)  approaches  zero  amplitude  in  about  8  seconds. 

It  is  safe  to  assume,  then,  that  if  a  single  term  in  f  (t)  contributed  the  8  second  response 
it  would  be  of  the  form  e  .  Based  upon  this  assumption  one  might  choose 

a  =  I. 

°  2 

(b)  Specification  of  p. 

It  has  been  shown  in  the  pole -location  theorem,  Theorem  2G,  that  the  pole¬ 
spacing  of  the  poles  of  (s)  exactly  equals  p.  p  must  be  chosen  a  priori  based  upon 
a  consideration  of  the  accuracy  required  of  the  approximation  f  (t).  It  can  be  shown 

that  choosing  one  value  of  p  over  another  affects  the  rate  of  convergence  of  f  (t)  as 

2  a 
measured  by  the  IE  numeric.  For  example,  it  may  take  3  terms  in  f&(t) 

jf&(t)  =  Cq  <t)Q(t)  +  cfp  (t)  +  <t>2  (t)]  with  p  =  ,  before  the  integral- squared  error 

numeric  is  less  than  or  equal  to  some  pre-accepted  accuracy  level,  while  it  may  only 

require  2  terms  in  f a(t)  with  p  =  p2  ,  before  the  integral- squared  error  numeric  is 

less  than  or  equal  to  the  same  pre-accepted  accuracy  level.  It  has  been  found  that 

choosing  the  value  of  p  such  that  the  poles  of  3^.  (s),  and  consequently  the  poles  of 

Fa(s),  lie  in  the  vicinity  of  the  poles  of  F(s)  and  surround  the  poles  of  F(s)  leads  to 

approximations  that  converge  very  rapidly.  Naturally,  this  choice  of  p  depends  upon 
i 

the  analysts  understanding  of  the  dynamics  of  the  system  being  studied. 
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(c)  Specification  of  A.  O.  (F&)  . 


It  has  been  shown  that  specifying  A.  O.  (F  )  is  equivalent  to  specifying 
A.  O.  ($k),  and  that 

A.  O.  ($k)  =  (1-  X2)  fe)  +1  (3.14) 


In  general,  A.  O.  (F  )  must  be  stated  a  priori.  For  systems  of  low  asymptotic- 
order  this  is  not  too  difficult  to  do.  One  need  only  look  at  the  portrait  of  f(t)  in  order 
to  determine  whether  or  not  f(o)  and/or  f  ^  (o)  are  zero.  On  the  other  hand,  it  is 
usually  impossible  to  determine  directly  from  f(t)  the  asymptotic -order  of  systems  of 
high  asymptotic -order.  In  these  cases,  one  may  have  to  resort  to  a  rather  detailed 
preliminary  analysis  of  the  system  involving,  perhaps,  high-frequency  testing,  since 
the  asymptotic-order  is  related  to  the  high-frequency  behavior  of  a  system. 

The  determination  of  the  asymptotic -order  is  probably  the  most  difficult  problem 
that  the  analyst  faces.  Much  more  work  needs  to  be  done  in  the  areas  of  experimental 
and  analytical  methods  useful  in  the  practical  determination  of  the  asymptotic -order 
of  a  system. 


(d)  Design  of  the  weighting  function. 


The  constants  X^c  and  X^  (a_c)  in  Eq.  (3.  6),  which  is  repeated  below  for  con¬ 
venience,  must  be  determined. 


w(t) 


e 


(a-c) 


(3.6) 


It  has  already  been  pointed  out  that  for 


and 


Xlc  =  ko 

P  =  k! 

\z  (a-c)  =  k2 


the  design  of  Eq.  (3.  6)  is  identical  to  the  design  of 


w(t) 


-k  k.  t 
o  1 


(3.7) 


(3.15) 


which  was  studied  in  Chapter  2.  The  design  procedure  developed  in  that  chapter  must 
be  modified  in  this  case  to  accommodate  the  requirement  that  p  be  specified  a  priori 
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[step  (b)  on  Page  5lJ.  The  procedure  is  outlined  below.  First  the  specifications 
on  w(t)  are  stated: 

1.  k^  is  specified  at  the  outset  as  the  spacing  of  the  poles  of  (s). 


2. 


tmax  ’  *n  ^2"  *s  ckosen  80  ^at  w(t)  emphasizes  a  region  of  time 


necessary  to  effect  the  maximum  emphasis  of  f(t),  over  that  same  region  of  time. 

It  is  designated  tg  . 

3.  w(t)  must  approach  zero  in  4  t  seconds  (see  page  35)  for  a  more  com¬ 
plete  discussion  o^  the  choice  of  Tg  ). 

Procedure  for  designing  w(t). 

Based  upon  the  above  specifications  on  w(t),  calculate 

kl  =  P 


1. 

2. 


1 

PTs 

Pt 


k2  = 


-  1 


PT 


(3.17) 

(3.18) 

(3.19) 


4.  Evaluate  AT  from  Eq.  (2.  8)  in  order  to  determine  w(t)'  s  width.  If, 
for  example,  AT  which  is  repeated’below  for  convenience, 


AT  = 


In 


2  k2  +  2  kQ  k2  +  k2  +^/k2  (  4  k2  +  4  kQ  k2  +  k^)" 


2  k2  +  2  ko  k2  +  k2  -  /k2  (  4  ko  +  4  k0  k^  +  k2) 


(2.8) 


i'stoo  small,  decrease  k_  ,  and,  with  k.  and  t  fixed,  re-evaluate  k  and  t  usine 

2  1  max.  o  6 

Theorem  4. 

Designing  w(t)  by  this  method  one  determines  the  constants  kQ  and  k^,  as 
desired.  Substituting  the  results  of  steps  (a)  through  (d)  into  Eqs.  (3.  7),  (3.13),  and 
(3.14)  one  is  able  to  determine  the  four  constants  c,  X.^,  a,  and  uniquely. 


2  a 

i  c 

k  +  - 

°  P 


(3.20) 


Xi  = 


1  + 


2  a 

c 

PkT 


(3.21) 
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=  ko+k2+  V  +2[  ^  O.  (^)  -1] 


i+  2  [a.  O.  (*k)  -l] 


(3.22) 


(3.23) 
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3.  4  Summary. 


It  has  been  the  purpose  of  this  chapter  to  present  a  general  method  fo„-  con¬ 
structing  sets  of  or  thonormalized  exponentials  so  that  these  sets  may  then  be  used 
as  the  approximants  in  the  identification  problem.  By  introducing  the  classical 
Jacobi  Polynomials  one  has  been  led  to  a  recursion  equation  in  the  time-domain  for 
determining  the  elements  of  the  exponential  set.  In  particular,  these  elements  have 


the  properties  that, 

-k  k.  t 

1.  they  are  orthonormal  with  respect  to  the  weighting  function  e  0  x 


2.  their  Laplace  Transforrrfs  may  be  of  any  desired  asymptotic-order,  and 


3.  their  poles  lie  along  the  negative-real  axis  of  the  s-plane  and  are  equally 

spaced. 
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CHAPTER  4.  THE  CHOICE  OF  A  SUITABLE  ERROR  CRITERION 


4.  1  Introduction 

Thus  far,  the  discussions  in  Chapters  1  and  3  have  considered  the  approxi¬ 
mation  of  a  function,  f(t),  in  an  integral-squared  sense.  It  was  pointed  out  in  those 

chapters  that  the  addition  of  more  and  more  terms  to  the  approximation  f  (t)  = 
m 

/  C.  (jj,  (t)  resulted  in  an  approximation  that  fitted  f  (t)  closer  and  closer, 
k  =  0  k  k 

It  has  been  mentioned  that,  in  many  circumstances,  a  close  fit  between  f^(t) 
and  f(t)  is  not  the  only  measure  of  performance  that  must  be  satisfied  by  the  approxi¬ 
mation.  In  Fig.  4.1.1  f  (t)  represents  the  identification  of  a  plant ,  f(t),  located  in 
the  forward  path  of  a  positional  servomechanism.  The  characterization  of  the  plant 
by  fa(t)  is  merely  the  first  step  in  a  study  of  the  closed-loop  system.  Ideally,  it  would 
be  desirable  for  the  results  of  such  a  study  to  agree  in  some  way  with  the  actual  results 


(a)  M 


Figure  4.1.1.  A  single-loop  feedback  system  in  which  f(t),.  in  (a), 
represents  the  plants  actual  characteristics  while  fa(t),  in  (b) , 
approximates  these  characteristics. 

that  would  have  been  obtained  had  f(t)  been  known  and  used  in  the  analyses. 

One  may,  for  example,  be  interested  in  performing  a  stability  analysis  on  the 
closed-loop  system.  Two  types  of  problems  occur  in  this  case.  The  first  can  be  called 
the  absolute  -  stability  problem  and  has  to  do  with  whether  or  not  the  system  ever 
becomes  unstable  and  for  what  values  of  gain,  K,  it  does  so.  Here  it  must  be  assumed 
thatK  takes  on  all  values.  Practically  speaking,  if  the  actual  plant,  f (t) ,  causes  the 
closed-loop  system  to  become  unstable  for  gain  it  would  seem  desirable  to  have  the 
approximate  plant  indicate  a  similar  behavior,  within  a  certain  allowable  margin  of 
error. 

The  second  type  of  problem  can  be  called  the  relative- stability  problem..  Here 
one  is  interested  in  the  behavior  of  the  closed-loop  response  as  K  varies  over  some 
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known  finite  range  of  values.  Is  c.(t)  always  overdamped  or  underdamped  for  the 
range  of  K  of  interest,  or  is  it  overdamped  for  some  values  of  K  and  underdamped  for 
others?  These  are  some  of  the  questions  that  a  relative  -  stability  analysis  answers. 

If,  for  example,  the  dynamics  of  the  actual  plant  cause  c(t)  to  be  underdamped  for 
<  K  <  K.,  then  it  would  be  desirable  to  have  the  approximate  plant  indicate  a 
similar  behavior  over  this  range  of  K,  again  within  an  allowable  margin  of  error. 

Some  of  the  techniques  applicable  to  both  types  of  stability  analysis  utilize 
the  frequency  response  of  the  plant  (Nyquist-polar  and  Bode -logarithmic  plots,  for 
example).  F(jto)  can  be  found  analytically  if  f(t)  is  known  (which,  of  course,  is  not 
the  case  here,  since  f  (t)  is  being  approximated),  or  experimentally,  if  the  plant  is 
available  for  frequency-response  measurements.  In  any  event,  it  also  appears  neces¬ 
sary  to  have  some  correspondence  between  both  the  magnitude  and  the  phase  of 
Fa  (jw)  and  of  F  (jio)  over  some  range  of  co  if  F&  (ju>)  is  to  predict  the  stability  of  the 
closed-loop  system  correctly. 

Figure  4.  1.  2  summarizes  some  of  the  performance  criteria  used  by  the  author 

for  choosing  the  functions  that  best  approximate  the  plant  f(t).  These  are  by  no  means 

the  only  measures  of  performance  that  can  be  chosen  and,  in  some  circumstances, 

31 

they  may  not  be  appropo  at  all.  Wescott  summarizes  the  difficulties  of  choosing  a 
performance  measure  when  he  states:  "The  ultimate  decision  of  what  constitutes  good 
performance  is  based  upon  human  judgement  or  even  personal  opinion  ....  the  end 
result  is  in  the  nature  of  a  hit  or  a  miss  ...  It  is  not  possible  in  a  general  way  to 
legislate  for  all  cases,  and  the  field  must  be  narrowed;  " 

2 

There  is  no  reason  to  assume  that  the  IE  criterion  should  lead  to  approxi- 

2 

matrons  which  simultaneously  minimize  the  IE  and  the  performance  criteria  of 
Fig.  4.  1.  2. 

The  purpose  of  this  chapter  is  to  present  the  details  and  the  results  of  a  study 
carried  out  to  determine  which  error  criteria  (many  of  which  are  well  established  in 
the  field  of  .Automatic  Control)  out  of  a  selected  group  of  eleven  lead  to  approximations 
which  best  approximate  f(t)  -  -  best  in  the  sense  that  these  approximations  satisfy  one 
or  more  of  the  performance  measures  listed  in  Fig.  4. 1.  2.  Also  of  concern  will  be 
the  effects  on  the  performance  of  the  fa(t),  as  measured  by  these  same  performance 
criteria,  of  choosing  approximations  of  incorrect  asymptotic-order,  as  compared  to 
approximations  having  the  correct  asymptotic -order. 

The  eleven  error  criteria  employed  in  this  study  were  subdivided  into  three 
families  of  error  criteria:  the  ITnE,  ITnE2  and  AE  -  ITnAE  families,  where 
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The  best  fa(t)  chosen  on  the  basis  of  a  comparison  of  the  closeness  of 
fit  between  the  approximations  and  f(t). 


The  best  f a(t)  chosen  on  the  basis  of  a  comparison  Of  the  closeness  of 
fit  between  the  |Fa(jw)|  and  the  |F(j<o)|,. 

The  best  fa(t)  chosen  on  the  basis  of  a  comparison  of  the  closeness  of 
fit  between  the  /F^fju)  and  the  /F(jio)  . 


The  best  fa(t)  chosen  on  the  basis  of  a  comparison  of  the  similarity 
between  the  relative- stability  of  the  closed-loop  systems  in  Fig.  4.  1.  1  a 
and  b,  for  a  range  of  loop  gain,  K,  greater  than  zero. 


The  best  f&(t)  chosen  on  the  basis  of  a  comparison  of  the  similarity 
between  the  absolute-stability  of  the  closed-loop  systems  in  Fig. 

4.  1.  1  a  and  b,  for  a  range  of  loop  gain,  K,  greater  than  zero  . 


The  best  fa(t)  chosen  on  the  basis  of  a  comparison  of  the  similarity 
between  the  absolute -stability  of  the  closed-loop  systems  in  Fig. 
4.1.1  a  and  b,  for  a  range  of  loop  gain,  K,  less  than  zero. 

Figure  4.1.  2.  Performance  measures  used  in  determining 
optimum  approximations. 


and 


oo 

ITnE  =  f  tn  (f  -  f  )  dt 

J  cl 

O 

00 

ITn  E  =  f  ln  (f  -  fa)  dt 
o 


AE  -  max  |  f  -  | 


00 

ITn  AE  =  j  tn  |f  -  fj  dt 
o 


(4. 1) 


(4.2) 

❖ 

(4.3) 


(4.4) 


❖ 


The  maximum  is  taken  with  respect  to  time  as  indicated  by  the  t  under  max. 
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Of  particular  interest  to  this  study  were  the  IE,  ITE,  IT2E,  IT"^^E,  IE2,  ITE2, 

IT  ^E2,  AE,  IAE,  ITAE,  and  IT  ^2  AE  criteria.  This  choice  of  error  criteria  was 

motivated  in  part  by  the  works  of  Graham  and  Lathrop^2',  Wescott2\  Handa^,  Newton 

et  al2^,  and  Walkovitch  et  al2^  who  investigated  various  means  for  designing  the  system 

in  Fig.  4.  I.  1  a.  Their  designs  were  based  upon  minimizing  such  measures  of  the 

error  e(t)  =  r(t)  -  c(t)  as  the  IE,  ITE,  ITZE,  IE2,  ITE2,  AE,  IAE,  and  ITAE  criteria. 

It  is  interesting  to  note  their  common  results  in  the  light  of  what  has  been  said  on 
2 

page  57  about  the  IE  criterion  and  the  choice  of  the  best  fa(t).  These  results  are 
stated  below. 

2 

(1)  While  the  IE  criterion  is  analytically  easier  to  handle  it  does  not 
lead  to  the  most  selective  design  ^  or  to  the  synthesis  of  a  system  having  the  best 
clo  sed-loop  performance  (in  terms  of  rise-time,  bandwidth,  etc.),  and 

(2)  The  optimal  designs  occur  when  the  measure  of  e(t)  is  heavily  weighted 
for  large  time  thus  placing  emphasis  on  "late"  errors. 

It  is  hoped  that  our  study  will  lead  to  a  similar  set  of  conclusions.  In  particu¬ 
lar,  answers  will  be  sought  for  the  following  14  questions. 


1.  In  each  family  of  error  criteria,  which  error  criterion  leads  to  approximations 
of  best  fit  between  f  (t)  and  f(t)? 

2.  In  each  family  of  error  criteria,  which  error  criterion  leads  to  approximations 
of  best  fit  between  |  F  ( j  to  )  |  and  |  E  ( j  w  )  |  ? 

3.  In  each  family  of  error  criteria,  which  error  criterion  leads  to  approximations 
of  best  fit  between  /  F  Qa>  )  and  /F  (ju  )  ? 


4.  In  each  family  of  error  criteria,  which  error  criterion  leads  to  approximations 
having  the  closest  relative  -  stability  (K  >  0)  correspondence  between  Fa(s)  and  F(s)  ? 

5.  In  each  family  of  error  criteria,  which  error  criterion  leads  to  approximations 

having  the  closest  absolute  -  stability  (K  >  0)  correspondence  between  F  (s)  and 
F(s)?  a 

6.  In  each  family  of  error  criteria,  which  error  criterion  leads  to  optimum 
approximations  -  -  optimum  in  the  sense  of  one  or  more  of  the  performance 
measures  listed  in  Fig.  4.1.2.  ? 

7.  From  the  eleven  error  criteria,  which  error  criterion  leads  to  approximations 
of  best  fit  between  f  (t)  and  f(t)  ? 

8.  From  the  eleven  error  criteria,  which  error  criterion  leads  to  approximations 
of  best  fit  between  |Fa(j<o)|  and  |F(jco  )  j  ? 


*  By  "  selective"  is  meant  that  a  minimum  value  of  the  measure  of  e  (t)  is  sharp 
as  system  parameters  are  varied. 


hQ 


9.  From  the  eleven  error  criteria,  which  error  criterion  leads  to  approximations 
of  best  fit  between  7F 


10.  From  the  eleven  error  criteria,  which  error  criterion  leads  to  approximations 
having  the  closest  relative  -  stability  {K  >  0)  correspondence  between  Fa(s)  and  F(s)  ? 

11.  From  the  eleven  error  criteria,  which  error  criterion  leads  to  approximations 
having  the  closest  absolute  -  stability  (K  >  0}  correspondence  between  Fa(s)  and  F(s)  ? 

12.  From  the  eleven  error  criteria,  which  error  criterion  leads  to  optimum  approxi¬ 
mations  -  -  optimum  in  the  sense  of  one  or  more  of  the  performance  measures  listed 
in  Fig.  4.  1.  2.  ? 

13.  Do  the  error  criteria  in  the  answers  to  the  twelve  preceding  questions  have  any¬ 
thing  in  common,  such  as  the  same  weighting  function? 

14.  Does  choosing  an  approximation  of  incorrect  asymptotic-order  have  a  noticeable 
affect  on  the  relative  -  and  absolute  -  stability  of  the  closed-loop  system? 


a(jw)  andyF(joi)  ? 


The  answers  to  these  14  questions  will  be  considered  in  Section  4.  4  and  will  be 
based  upon  the  analyses  discussed  in  Section  4.  3. 

Before  the  eleven  error  criteria  are  discussed  in  greater  detail  let  us  reemphasize 
the  type  of  functions  under  study.  Here,  as  in  the  preceding  chapters,  all  conclusions 
will  be  based  upon  approximations  of  the  function 


by 


N 

f(t)  =  j]  \  e  ",  mk  real 
k  =  0  * 


mkt 


f.i*»  -  kE0  ck  +k<*> 


(4.5) 


(4.6) 


where  the  <b  (t)  are  linear  combinations  of  exponential  functions.  In  order  to  utilize 

h  2 

the  theory  developed  in  the  preceding  chapters,  for  the  IE  criterion,  the  poles  of  the 
4?k(s)  are  chosen  from  an  equally- spaced  set.  In  this  case,  the  (|>k  (t)  become 


0-1  /  \  , 

l  B, 

£  (-1/  a'l\  «  -(v  +  i)pt 

v=  0 

F 

11  1 
O 

i _ 

e  ^  is  a  factor 

of  (j>k  (t),  -  p  being  the  first  pole  o 

(4.  7) 


p  is  the  pole-spacing  of  the  $k(s)  and  subsequently  it  is  also  the 
pole-spacing  of  Fa(s),  and 

a  is  A.  O.  (4?,  )  which  is  the  same  as  A.  O.  (F  )  . 


where 
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If  the  <j)j^  (t)  are  orthonormalized,  as  must  be  the  case  in  the  ITnE^  family,  the  con¬ 
stants  13^  will  be  found  using  the  orthonormalization  procedure.  If,  on  the  other  hand, 
no  such  orthonormalization  is  utilized,  as  in  the  approximations  involving  the  ITnE 
and  AE  -  ITnAE  families,  the  will  eventually  be  absorbed  into  the  coefficients, 

C^.  ,  of  Eq.  (4.  6);  hence,  in  these  cases,  all  of  the  ,  in  Eq.  (4.  7)  will  be  set  equal 
to  unity,  in  order  to  simplify  the  algebra  in  the  calculation  of  the  . 

In  any  event,  the  coefficients  in  Eq.  (4.  6)  are  found  by  minimizing  one  of  the 
error  criteria  in  Eqs.  (4. 1),  (4.  2),  (4.  3),  or  (4.  4).  These  error  criteria  and  the 
calculation  of  the  are  discussed  in  greater  detail  in  the  following  section. 
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4.  2 _ The  Error  Criteria 

In  this  section  the  eleven  error  criteria  are  phrased  in  terms  of  the  functional 
notation  used  in  Chapter  I  in  order  to  obtain  a  graphical  account  of  the  effects  the 
various  weighting  functions  have  on  these  criteria. 

(al  lTnEZ  Family 


Equation  (4.  2)  can  be  expressed  in  functional  notation  by  letting  tn  (f  -  f  )Z^= 


[+(e),  tn  , 


where  e  =  f  -  f  and  ijj  (e)  =  e  . 


ITnE2  =  J  |*(e),  tnJ  dt  =  F  |^e2  ,  tnJ 


(4.  8) 


Here  F  —  f  dt. 


The  second  column  of  Fig.  4.  2.  1  summarizes  the  effects  of  the  three  weighting 

-  1/2  2 

functions  1,  t,  and  t  1  on  e  (t)  while  the  last  column  illustrates  exactly  what  is 
2  2  -  1/2  2 

meant  by  the  IE  ,  I TE  ,  and  IT  '  E  measures.  Figure  4.2.  2  details  the  pro¬ 
jective  geometric  techniques  used  for  obtaining  the  entries  in  Fig.  4.  2.  1. 

n  2 

One  of  the  major  problems  facing  the  analyst  when  using  the  IT  E  criteria 

in  signal  analysis  is  the  determination  of  the  constants  B  in  Eq.  (4.  7)  via  an  ortho- 

V  2 

normalization  procedure.  This  problem  has  already  been  resolved  for  n  =  0  (IE  )  in 
the  first  three  chapters  of  the  dissertation.  Unfortunately,  there  is  no  simple  way  of 
.extending  these  results  to  other  values  of  n.  For  values  of  n  not  equal  to  zero  one  can 
always  fall  back  upon  Eq.  (1.  3),  which  is  repeated  below  as  Eq.  (4.  9), 

oo 

/  tn  cj,  (t)  <),  (t)  dt  =  6..  (4.  9) 

‘  o  J  J 

and  carry  out  the  orthonormalization  of  the  ^(t)  in  Eq.  (4.  7)  by  first  specifying,  P  and 
the  pole  spacing  p.  This  procedure  must  be  carried  out  anew  every  time  one  chooses 
to  use  a  different  set  of  poles  in  ^(s),  for  doing  this, ,natur ally, implie s  a  change  in  P 
and/or  p  in  Eq.  (4.  7). 

(b)  I  TnE  Family 

Equation  (4.  1)  can  be  rewritten  in  terms  of  functional  notation  as 
oo 

I  Tn  E  =  f  ^(e),  tn]  dt  =  F[e,  tn  J 


(4.10) 
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oo 

where  e  =  f  -  f  ,  4<(e)  -  e,  and  F  =  J  dt.  Figure  4.  2.  3  summarizes  the  ITnE 

family  for  n  =  0,  1,  2,  and  -  1/2  . 

Substituting  Eqs.  (4.  6)  and  (4.  7)  into  Eq.  (4.  10),  it  is  straightforward  to  show 

that  the  minimization  of  Eq.  (4.10)  results  in  a  single  equation  in  the  (m  +  1)  unknowns, 

C  ,  Cp . Cm  .  This  condition  occurs  because  the  minimum  value  of  Eq.  (4.10) 

can  actually  be  chosen  to  be  zero;  hence,  one  needs  m  additional  equations  if  one  is  to 
obtain  a  unique  solution  for  the  (m  +  1)  C^..  These  might  be  given  in  the  form  of  con¬ 
straints  between  f  (t)  and  f(t),  and  the  derivatives  of  f  (t)  and  f(t),  at  various  values 
a'  a 

of  time. 

It  is  important  to  remember  that  the  minimization  of  an  ITnE  criterion  js  not 

:  "  m 

sufficient  for  determining  the  constants  in  the  approximation  fa(t)  =2  '"'k  ^ 

- k_  o  - 

(c)  AE  -  ITnAE  Family 

Withj^i  (e),  tnJ  =  tn  j  f  -  f  a  ] ,  e  =  f  -  fa>  and  i);  (e)  =  |e|Eqs,(4,3)  and  (4,4) 
can  be  written  as 

AE  =  ra^ax  [  4>  (e)  J  (4.11) 

JTnAE  =  f  J^(e),  tnj  dt  =  F  |j  e  | ,  tnj  (4,12) 

The  dependence  of  these  criteria  on  |e]  and  tn  is  illustrated  in  Figure  4.2.4  for 
n  =  0,  1,  and  -  1  / 2. 

The  minimization  of  Eqs.  (4.  11)  and  (4.  12)  to  find  the  (m  +  1)  constants 
CQ,  Cp  ....  in  the  approximation  Eq.  (4.  6)  can  not  be  done  analytically.  This  is 
due  to  the  fact  that  one  has  chosen  to  work  with  a  function  of  the  absolute  value  of  the 
error  e(t)  which  is  non-analytic.  To  be  able  to  carry  out  the  integration  in  Eq.  (4.12) 
by  hand,  one  would  have  to  know  the  internal  zero  crossings  of  e(t)  alfeng  the  t-axis. 
Solving  for  these  zeros  is  usually  an  extremely  difficult  task.  The  determination  of  the 
(m  +  1)  coefficients  from  the  minimization  of  Eq.  (4.  11)  is  an  even  more  difficult  task 
than  the  determination  of  the  (m  +  1)  constants  in  Eq.  (4.  12)  .  This  is  due  to  the  ad  - 
ditional  maximization  of  |e|  with  respect  to  t,  in  Eq.  (4.11).  A  trial  and  error  (.scanning; 
procedure  for  the  minimization  of  the  AE  and  IT  AE  criteria  on  a  digital  computer  is 
discussed  in  Appendix  C.  There,  the  problems  of  finding  the  coefficients  in  Eqs.  (4.11) 
and  (4.  12)  reduce  to  the  development  of  optimal  computer  programs  and  scanning 
techniques. 
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Based  upon  the  discussions  in  this  section  and  in  Section  4.  1,  one  is  now  in 
a  position  to  set  up  a  problem  which,  hopefully,  will  provide  the  answers  to  the  ques¬ 
tions  posed  at  the  end  of  Section  4.  1.  This  is  done  in  the  next  section. 
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4.  3.  The  Error  Problem 

In  order  to  answer  the  questions  posed  at  the  end  of  Section  4.1,  the  functions 
f (t)  listed  in  the  first  column  of  Table  4.  3.1  are  approximated  by  the  functions  in  the 
last  column  of  that  table.  Figure  4.  3.1  summarizes  the  three  major  steps  taken  in 
the  analysis.  These  steps  are: 


Figure  4.  3.  1.  Summary  of  the  three  major  steps  taken  in  the 
error  problem  analysis. 

(a)  Determination  of  the  coefficients  . 

Corresponding  to  each  entry  in  Table  4.  3.  1  eleven  approximations  were  deter¬ 
mined,  one  for  each  of  the  eleven  error  criteria.  The  calculation  of  the  C,  ,  which 

k 

has  already  been  discussed  in  some  detail  in  Section  4.  2  is  summarized  in  the  flow 

chart  of  Figure  4.  3.  2.  A  summary  of  the  numerical  values  for  the  C^,  calculated  as 

indicated  on  Fig.  4.  3.  2,  corresponding  to  the  approximations  listed  in  Table  4.  3.  1,  is 

presented  in  Appendix  D.  Two  problems  worthy  of  further  discussion  arose  during 

the  calculation  of  the  C,  . 

k 

The  first  of  these  has  to  do  with  the  problem  of  roundoff  effects  due  to  keeping 
only  a  finite  number  of  decimal  places  in  a  computation.  It  was  found  that  these  effects 
are  particularly  severe  for  the  calculations  of  the  C^.  within  the  ITnE^  family.  A  desk 
calculator  was  used  to  evaluate  these  constants  and  the  results  were  rounded  off  to 
four  places  during  the  calculations,  which  was  well  above  the  accuracy  requirements 
of  other  parts  of  the  problem.  Four  places,  although  quite  sufficient  for  the  ,  is 
not  nearly  good  enough  for  the  calculations  of  the  ITnE^  numeric  in  the  three-term 
approximations.  In  many  cases  negative  values  are  obtained  for  these  errors'.  The 
inadmissability  of  such  results  is  obvious  from  the  definition  of  the  ITnE^  criteria  in 
Eq.  (4.2). 

Hamming  ^  discusses  a  number  of  theories  that  have  been  developed  by  numeri¬ 
cal  analysts  dealing  with  estimates  of  computational  accuracies  before  a  computation 

.  13 

is  begun.  The  reader  will  find  many  enlightening  discussions  of  (to  quote  Hamming  ) 
"the  round-off  noise  problem"  in  the  textbook  written  by  Hamming. 
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Figure  4.  3.  1  .  Summary  of  the  three  major  steps  taken  in  the 
error  problem  analysis. 
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Corresponding  to  each  entry  in  Table  4.  3.1  eleven  approximations  were  deter¬ 
mined,  one  for  each  of  the  eleven  error  criteria.  The  calculation  of  the  C,  ,  which 

k 

has  already  been  discussed  in  some  detail  in  Section  4.  2  is  summarized  in  the  flow 

chart  of  Figure  4.  3.  2.  A  summary  of  the  numerical  values  for  the  C^,  calculated  as 

indicated  on  Fig.  4.  3.  2,  corresponding  to  the  approximations  listed  in  Table  4.  3.1,  is 

presented  in  Appendix  D.  Two  problems  worthy  of  further  discussion  arose  during 

the  calculation  of  the  C,  . 

k 

The  first  of  these  has  to  do  with  the  problem  of  roundoff  effects  due  to  keeping 
only  a  finite  number  of  decimal  places  in  a  computation.  It  was  found  that  these  effects 
are  particularly  severe  for  the  calculations  of  the  C^.  within  the  ITnE^  family.  A  desk 
calculator  was  used  to  evaluate  these  constants  and  the  results  were  rounded  off  to 
four  places  during  the  calculations,  which  was  well  above  the  accuracy  requirements 
of  other  parts  of  the  problem.  Four  places,  although  quite  sufficient  for  the  ,  is 
not  nearly  good  enough  for  the  calculations  of  the  ITnE^  numeric  in  the  three-term 
approximations.  In  many  cases  negative  values  are  obtained  for  these  errors'.  The 
inadmis sability  of  such  results  is  obvious  from  the  definition  of  the  ITnF,  criteria  in 
Eq.  (4.2). 

Hamming''3  discusses  a  number  of  theories  that  have  been  developed  by  numeri¬ 
cal  analysts  dealing  with  estimates  of  computational  accuracies  before  a  computation 
is  begun.  The  reader  will  find  many  enlightening  discussions  of  (to  quote  Hamming  ) 
"the  round-off  noise  problem"  in  the  textbook  written  by  Hamming. 
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Table  4.  3.  1.  Summary  of  the  functions  used  to  approximate 

_  -2t  „  -4t  ,  -2t  ,  -4t  * 

e  -  e  and  e  +  e  . 


_  -3t  „  _  -5t 

Co  c  +  Cx  e 


C  e  _t  +  C,  e  -3t  +  C?  e  '5t 

o  1  2 


*  A  graphical  portrait  of,/  "  t  "t ,e  ”  immediately  reveals  that  A.  O.  (F)  =  1;  thus, 
the  approximations  ofe  +  e  are  chosen  such  that  A.  O.  (F  )  =  1.  The  approxi¬ 
mations  of  e  -t  fi  1  serve  primarily  to  check  the  validity  of  the  conclusions  drawn 
from  the  approximations  of  e  -  e 
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ADDITIONAL  CONSTRAINTS 
BETWEEN  fQ(t)  ond  f(t) 


Figure  4,  1.  2.  Flow  chart  indicating  ttn.  uotermination  of  the 


coefficients  C, 
k 

where  <j)^  (t)  =  e 


in  the  approximation  f  (t)  =  /  C,  (j>,  (t), 

-dkt  a  1(p=0  K  k 
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The  second  problem  has  to  do  with  the  limitations  of  the  IBM  650  computer 
which  was  the  digital  computer  used  to  evaluate  the  constants,  C,  ,  within  the  AE- 
IT  AE  family  of  error  criteria.  It  is  not  feasible  to  perform  a  three-dimensional  scan 
on  the  650  due  to  the  prohibitive  length  of  time  such  a  scan  requires.  The  machine  is 
not  fast  enough  for  such  a  program;  thus,  most  of  the  conclusions  in  this  chapter  are 
based  upon  the  one  and  the  two  term  approximations. 

(b)  Data  Processing 

In  order  to  determine  which  error  criteria  led  to  the  best  approximations  as 
discussed  in  Section  4.1,  the  eleven  approximations  corresponding  to  each  entry  in 
Table  4.  3.  1  were  processed  in  the  manner  indicated  on  the  flow  chart  in  Figure  4.  3.  3. 

A  brief  explanation  of  the  calculations  listed  on  Fig.  4.  3.  3.  that  are  not  self-explanatory 
follows. 

i)  Magnitude  -  and  Phase-Error  Calculations: 

The  magnitude  and  phase  angle  of  F(jo)  and  F  (jw)  were  compared  at 

el 

seven  discrete  values  of.w  (co  =  0,  1,  2,  3,  4,  5,  and  10  rad.  /  sec.  )  by  forming  the  magni¬ 
tude  and  phase  error  functions,  E^fco)  and  E  (u>)  respectively..  These  calculations 
were  carried  out  on  the  IBM  650  computer.  The  seven  values  of  w  (  u >  =  0,  1,  2,  3,  4, 

5,  and  10  rad.  /  sec.  )  were  chosen  so  that  a  comparison  of  the  low-midband  -,  and  high- 
frequency  jj'high"  in  relation  to  the  location  of  the  two  poles  of°C  ^f(t)  =  e  ^  -  e  , 

at  s  =  -2.  and  s  =  -4,  and  to  the  location  of  the  two  poles  and  single  zero  of 

~2t  “4t )  -i 

<£{f(t)  =  e  +  e  |  ,  at  s  =  -2,  -4  and  s  =  -3  respectively]  behavior  of  the  magnitude 

and  phase  angle  of  F(jio)  and  F&  (jio  )  could  be  made. 

ii)  Absolute-Stability  Analysis: 

Root-locus  techniques  were  used  to  determine  whether  or  not  the  system 
in  Fig.  4.1.1,  which  is  repeated  below  as  Fig.  4.3.4,  became  unstable  when  the  actual 


(a)  (b) 


Figure  4.  3. 4.  A  single-loop  feedback  system  in  which  f(t),  in  (a), 
represents  the  plants  actual  characteristics  while  f  (t) ,  in  (b), 
approximates  these  characteristics. 
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plant  was  replaced  by  each  one  of  the  eleven  approximations  to  the  plant.  If  the  system 
became  unstable  the  gain  at  which  instability  occurred  was  also  recorded.  This  was 
done  for  both  positive  and  negative  values  of  gain  K.  Figure  4.  3.  5  summarizes  the 

stability  behavior  of  the  system  containing  the  actual  plants  under  study;  that  is,  for 

-2t  -4t  ,,  -2t  -4t 

f(t)  =  e  ••  e  ,  and  for  f(t)  =  e  +  e 

iii)  Relative -Stability  Analysis: 

By  using  root-locus  techniques  it  was  possible  to  determine  the  loop-gain  K 
required  for  the  closed-loop  response,  c(t)  [see  Fig.  4.  3.  4  ,J  to  behave  in  some  pre¬ 
scribed  manner,  e.  g.  t,  =  0.  707.  This  was  done  for  each  one  of  the  eleven  one  -, 
two  -,  and  three  -  term  approximations  listed  in  Appendix  D,  and  was  also  done  for 
the  actual  plant,  f(t),  in  order  that  the  loop  gain  necessary  for  the  actual  system  to 
achieve  a  prescribed  value  of  damping  (t,)  could  be  compared  to  the  loop  gain  necessary 
for  the  approximate  system  to  achieve  the  same  value  of  1,.  The  purpose  of  such 
analyses  was  to  determine  which  error  criteria  led  to  approximations  whose  root  loci 
correspond  closely  to  the  loci  of  the  actual  plant  over  a  reasonable  range  of  gain  K. 
Stated  another  way,  the  purpose  of  the  analyses  was  to  determine  which  error  criteria 
led  to  approximations  whose  closed-loop  response  corresponded  closely  to  the  closed- 
loop  response  of  the  actual  plant  over  a  reasonable  range  of  K. 

(c)  Data  Evaluation 

The  processed  approximations  were  evaluated  as  indicated  in  Fig.  4.3.6  in 
order  to  determine  which  error  criterion  or  which  groups  of  criteria,  yield  approxi¬ 
mations  satisfying  the  performance  measures  listed  therein.  This  was  done  in  two 
ways. 

First,  the  eleven  approximations  were  split  up  into  three  families  correspond¬ 
ing  to  the  three  families  of  error  criteria  from  which  they  had  been  derived.  The  data 
was  then  evaluated  by  comparing  only  the  approximations  from  within  a  family  of  error 
criteria.  This  was  done  in  order  to  determine  which  error  criterion  (or  criteria), 
from  within  a  family  of  error  criteria,  leads  (lead)  to  optimum  approximations  -  - 
optimum,  in  the  sense  that  the  f  (t)  satisfy  any  one  or  more  of  the  performance 
measures  listed  in  Fig.  4.  3.  6. 

As  an  example,  consider  the  determination  of  the  error  criterion  (or  criteria) 

in  the  ITnE  family  which  leads  (lead)  to  approximations  having  the  "best  fit  between 

f  (t)  and  f(t)"  .  For  each  of  the  one-and  two-term  approximations  listed  in  Table 
£L 

4.  3.1  four  approximations  were  calculated,  one  corresponding  to  each  of  the  four  error 
criteria  in  the  ITnE  family.  These  approximations  are  summarized  in  Appendix  D. 


Flow  chart  indicating  the  processing  of  the  approximations 
^  anc^  £ke  evaluation  of  the  processed  approximations. 
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Each  set  of  four  approximations  was  then  compared  to  f (t)  at  the  19  values  of  t  at 
which  these  functions  had  been  evaluated.  Based  upon  this  comparison  the  function 
(or  functions)  that  best  approximated  f(t),  in  the  sense  of  the  best  fit  between  f _^(t)  and 
f(t),  was  (were)  found.  Corresponding  to  this  function  (or  these  functions)  was  one  of 
the  four  error  criteria  (or  more  than  one)  within  the  ITnE  family.  The  result  of  in¬ 
terest  is  the  frequency  (number  of  times)  with  which  an  error  criterion  within  the 
ITnE  family  leads  to  an  optimum  f  (t)  -  -  optimum  in  the  sense  of  the  closest  fit  be¬ 
tween  f  (t)  and  f  (t)  . 

I 

The  frequency  with  which  an  error  criterion  leads  to  optimum  approximations  -- 
optimum  in  the  sense  of  any  one  or  more  of  the  performance  measures  listed  in  Fig. 
4.3.6,  versus  error  criteria,  is  tabulated  in  Appendix  E.  Tables  E.  1,  E.  2,  E.  3,  and 
E.  4  summarize  the  frequency  with  which  an  error  criterion  leads  to  optimum  approxi¬ 
mations  when  the  sample-space  is  restricted  to  the  error  criteria  from  within  a  family 
of  error  criteria.  The  frequency,  that  a  particular  error  criterion  produces  the  closest 
fit  between  f&  (t)  and  f(t),  that  a  particular  error  criterion  produces  the  closest  fit 
between  |  Fa  (joj)|  and  |F  ( j  co )  | ,  that  a  particular  error  criterion  produces  the  closest 
fit  between  ^  (ju)  and  ^/F(j<j)  ,  that  a  particular  error  criterion  produces  the 
closest  relative  -  stability  correspondence  between  Fa(s)  and  F(s),  and,  that  a  particular: 
error  criterion  produces  the  closest  absolute  -  stability  correspondence  between  Fa(s) 
and  F  (s),  is  plotted  versus  error  criteria  in  Figures  4.  3.  7a,  4.  3.  8a,  4.  3.  9a,  4.  3.  10a, 
and  4.  3.11a  respectively.  These  plots  were  obtained  by  adding  the  tabulated  data  in 
Tables  E.  1,  E.  2,  E.  3,  and  E.  4  fob  each  one  of  the  above  performance  measures  and 
for  each  error  criterion;  these  sums  were  then  plotted  versus  their  respective  error 
criterion  (for  a  particular  performance  measure). 

Returning  to  the  example  of  the  determination  of  the  error  criterion  (or  criteria) 

in  the  ITnE  family  which  leads  (lead)  to  approximations  having  the  "best  fit  between 

-l/2 

fa(t)  and  f  (t)"  ,  one  is  able  to  conclude,  upon  inspection  of  Fig.  4.  3.  7a,  that  the  IT  '  E 

criterion  leads  to  more  approximations  having  the  closest  fit  between  f  (t)  and  f(t)  than 

2  a 
do  the  IE,  ITE,  and  IT  E  criteria. 

A  summary  of  the  conclusions  which  one  is  able  to  draw  from  Figures  4.  3.  7a, 

4.  3,  8a,  4.  3.  9a,  4.  3.  10a,  and  4.  3.  11a  is  presented  in  the  next  section,  Section  4.  4. 

Figures  4.  3. 12a,  4.  3. 13a,  4.  3.  14a,  and  4.  3. 15a  present  an  alternate  display 
of  the  results  tabulated  in  Tables  E.  1,  E.  2,  E.  3,  and  E.  4  respectively.  These  figures 
were  obtained  by  first  summing  the  numbers  in  each  error  criterion  column,  in  each 
one  of  the  tables,  E.  1,  E.  2,  E.  3,.  and  E.  4  respectively,  and  by  then  plotting  each  one 
of  these  sums  versus  its  respective  error  criterion.  The  sum  of  these  numbers 
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corresponds  to  the  frequency  with  which  an  error  criterion  leads  to  an  optimum  f &(t)  -- 
optimum  in  the  sense  of  any  one  or  more  of  the  performance  measures  listed  in  Fig. 

4.  3.  6.  Figure  4.  3. 16  is  an  additive  summary  of  Figs.  4.  3.  12a,  4.  3.  13a,  4.  3. 14a, 
and  4.  3.15a.  The  important  conclusions  drawn  from  all  of  these  figures  are  discussed 
in  the  next  section. 

In  the  second  method  of  data  evaluation,  the  data  was  evaluated  by  comparing 
the  approximations  from  all  of  the  error  criteria.  This  was  done  in  order  to  determine 
which  error  criterion  (or  criteria)  leads  (lead)  to  optimum  approximations  -  -  optimum 
in  the  sense  that  the  f a(t)  satisfy  any  one  or  more  of  the  performance  measures  listed 
in  Fig.  4.  3.  6. 

As  an  example,  consider  the  determination  of  the  error  criterion  (criteria) 
which  leads  (lead)  to  approximations  having  the  "best  fit  between  f^(t)  and  f  (t)"  .  For 
each  of  the  one  -  and  two-term  approximations  listed  in  Table  4.  3.  1  eleven  approxima¬ 
tions  were  calculated,  one  corresponding  to  each  of  the  eleven  selected  error  criteria 
(IE,  1TE,  IT2E,  IT~^ZE,  IE2,  ITE2,  1T"1/2E2,  AE,  IAE,  ITAE,  IT'^AE).  These 
approximations  are  summarized  in  Appendix  D.  Each  set  of  eleven  approximations  was 
then  compared  to  f(t)  at  the  19  values  of  t  at  which  these  functions  had  been  evaluated. 
Based  upon  this  comparison  the  function  (or  functions)  that  best  approximated  f(t),  in 
the  sense  of  the  best  fit  between  f&(t)  and  f(t),  was  (were)  found.  Corresponding  to  this 
function  (or  these  functions)  was  one  of  the  eleven  error  criteria  (or  more  than  one). 

The  result  of  interest  is  the  frequency  (number  of  times)  with  which  an  error  criterion 

leads  to  an  optimum  f  (t)  -  -  optimum  in  the  sense  of  the  closest  fit  between  f  (t)  and 
a  a. 

f(t). 


Tables  E.  5,  E.  6,  E.  7,  and  E.  8  summarize  the  frequency  with  which  an  error 
criterion  leads  to  optimum  approximations  when  the  sample -space  includes  all  eleven 
error  criteria.  The  frequency,  that  a  particular  error  criterion  produces  the  closest 
fit  between  f a( t)  and  f(t),  that  a  particular  error  criterion  produces  the  closest  fit  be¬ 
tween  |F  (jto)|  and.  |F(jio)|,  that  a  particular  error  criterion  produces  the  closest 
fit  between  y'F^jto)  and  y/F(jw)  ,  that  a  particular  error  criterion  produces  the  closest 
relative  -  stability  correspondence  between  F  (s)  and  F(s),  and,  that  a  particular  error 
criterion  produces  the  closest  absolute  -  stability  correspondence  between  Fa(s)  and 
F(s),  is  plotted  versus  error  criteria  in  Figures  4.  3.  7b,  4.  3.  8b,  4.  3.  9b,  4.  3. 10b,  and 
4.  3.  lib  respectively.  These  plots  were  obtained  by  adding  the  tabulated  data  in  Tables 
E.  5,  E.  6,  E.  7,  and  E.  8  for  each  one  of  the  above  performance  measures  and  for  each 
error  criterion;  these  sums  were  then  plotted  versus  their  respective  error  criterion 


(for  a  particular  performance  measure). 
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Returning  to  the  example  of  the  determination  of  the  error  criterion  (or  criteria) 
which  leads  (lead)  to  approximations  having  the  "best  fit  between  fa(t)  and  f(t)"  ,  one 
is  able  to  conclude,  upon  inspection  of  Fig.  4.  3.  7b,  that  the  IT  *"/2  AE  and  IT-1/2E 
criteria  lead  to  more  approximations  having  the  closest  fit  between  f a(t)  and  f(t)  than 
do  the  other  nine  error  criteria. 

A  summary  of  the  conclusions  which  one  is  able  to  draw  from  Figures  4.  3.  7b, 

4.  3.  8b,  4.  3.  9b,  4.  3.  10b,  and  4.  3.  lib  is  presented  in  the  next  section,  Section  4.  4. 

Figures  4.  3. 12b,  4.  3.  13b,  4.  3.  14b,  and  4.  3.  15b  present  an  alternate  display 
of  the  results  tabulated  in  Tables  E.  5,  E.  6,  E.  7,  and  E.  8  respectively.  These  figures 
were  obtained  by  first  summing  the  numbers  in  each  error  criterion  column,  in  each 
one  of  the  tables,  E.  5,  E.  6,  E.  7,  and  E.  8  respectively,  and  by  then  plotting  each  one 
of  these  sums  versus  its  respective  error  criterion.  The  sum  of  these  numbers  corre¬ 
sponds  to  the  frequency  with  which  an  error  criterion  leads  to  an  optimum  fa(t)  “  ■ 
optimum  in  the  sense  of  any  one  or  more  of  the  performance  measures  listed  in  Fig. 

4.  3.  6.  Fig.  4.  3.  17  is  an  additive  summary  of  Figs.  4.  3.  12b,  4.  3.  13b,  4.  3. 14b,  and 
4.  3.15b.  The  important  conclusions  drawn  from  all  of  these  figures  are  discussed  in 
the  next  section. 

While  it  was  not  possible  to  calculate  the  three-term  approximations  for  the 
AE,  IAE,  ITAE,  and  IT’1/2  AE  criteria,  due  to  the  limitations  of  the  IBM  650  comupter, 
it  was  possible  to  calculate  the  three-term  approximations,  listed  in  Table  4.  3.  1,  for 
the  other  seven  error  criteria.  The  results  of  these  calculations  can  be  found  in 
Appendix  D.  These  approximations  were  processed  (see  Fig.  4.3.  3)  and  the  resulting 
data  was  then  evaluated  by  using  the  second  method  for  data  evaluation,  described  on 
page  78.  Naturally,  the  sample  -  space,  in  this  case,  consists  only  of  seven 

error  criteria:  IE,  ITE,  IT2E,  IT_1/2E,  IE2,  ITE2,  and  IT'1//2E2  criteria.  Table 
E.  9  summarizes  the  frequency  with  which  an  error  criterion  leads  to  optimum  three - 
term  approximations  when  the  sample-space  includes  these  seven  error  criteria. 

Figure  4.  3.18  presents  a  graphical  summary  of  Table  E.  9.  It  was  obtained  by  first 
summing  the  numbers  in  each  error  criterion  column  in  Table  E.  9,  and  by  then  plotting 
each  one  of  these  sums  versus  its  respective  error  criterion.  This  sum  corresponds 
to  the  frequency  with  which  an  error  criterion  leads  to  optimum  three -term  f  (t)  -  - 
optimum  in  the  sense  of  any  one  or  more  of  the  performance  measures  listed  in 
Fig.  4.  3.  6. 


(b) 


Figure  4.  3.  8.  Frequency  (number  of  times),  that  a  particular 
error  criterion  produced  the  closest  fit  between  |F  ( j co  )| 
and  |F  (j«)|  ,  versus  error  criteria,  (a)  Sample-^space 
restricted  to  a  family  of  error  criteria  (indicated  by  dashed 
lines);  (b)  sample-space  included  all  eleven  error  criteria. 


M.R.I.-I9I37 


Figure  4.  3.  9.  Frequency  (number  of  times),  that  a  particular 
error  criterion  produced  the  closest  fit  between  /F  R  (.jio) 
and  /f  (ju)  ,  versus  error  criteria,  (a)  Sample-space 
restricted  to  a  family  of  error  criteria,  (indicated  by  dashed 
lines);  (b)  sample-space  included  all  eleven  error  criteria. 


M.R.I.-I9I38 


ERROR  CRITERIA 


Figure  4.  3.  10.  Frequency  (number  of  times),  that  a  particular 

error  criterion  produced  the  closest  relative  -  stability  corres¬ 
pondence  between  Fa(s)  and  F(s),  versus  error  criteria. 

(a)  Sample-space  restricted  to  a  family  of  error  criteria 
(indicated  by  dashed  lines);  (b)  sample-space  included  all 
eleven  error  criteria. 


M.R.I. -19139 


Figure  4.  3.  11.  Frequency  (number  of  times),  that  a  particular 

error  criterion  produced  the  closest  absolute  -  stability  corres¬ 
pondence  (K  >  0)  between  F  (s)  and  F  (s),  versus  error  criteria, 
(a)  Sample-space  restricted  to  a  family  of  error  criteria 
(indicated  by  dashed  lines);  (b)  sample-space  included  all  eleven 
error  criteria. 


M.R.I.-I9I41 
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(o) 


Figure  4.  3.  13.  Frequency  (number  of 
criterion  led  to  an  optimum  (t) 
the  sense  that  the  f  (t)  satisfied  an} 
criteria  listed  on  F^g.  4.  3.  6,  versi 

_  -2t  -4t  ,  .  „  . 

c  -  C  .  (.a)  Sample -space  r 

criteria  (indicated  by  dashed  lines) 
eleven  error  criteria. 


Figure  4.3.14.  Frequency  (number  of  times),  that  a  particular  error 
criterion  led  to  an  optimum  fa(t)  ^A.  O.  (Fa)  =  3j  -  -  optimum  in 
the  sense  that  the  f  (t)  satisfied  any  one  or  more  of  the  performance 
criteria  listed  on  F^g.  4.  3.  6,  versus  error  criteria.  Here  f  (t)  == 

-Zt  -4t 

e  -  e  .  (a)  Sample- space  restricted  to  a  family  of  error 

criteria  (indicated  by  dashed  lines);  (b)  sample -space  included  all 
eleven  error  criteria. 


M.R.I. -19145 


Figure  4.  3.  16.  Additive  summary  of  Figures  4.  5.  12a,  4.  3.^13a, 
4.3.14a,  and  4.3.15a.  (a)  AE-ITnAE  family,  (b)  IT  E 

family,  (c)  ITnE  family. 


M.R.I.-I9I42 
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•  4,  4  Results 

The  results  of  this  study  are  presented  below  as  answers  to  the  fourteen  ques¬ 
tions  posed  at  the  end  of  Section  4.  1.  They  were  obtained  from  the  evaluated  data, 
most  of  which  is  presented  in  tabular  form  in  Appendix  E  and  in  graphical  form  in 
Figs.  4.  3.  7  -  4.  3.  18. 


A.  Approximations  of  best  fit  between  f &(t)  and  f (t) :  Within  each  family  of  error 

criteria,  weighting  small-time  heavily  leads  to  approximations  of  best  fit  to  f(t) 
jirig.  4.  3.7aj.  More  specifically,  within  the  ITnE  family  of  error  criteria,  the  IT  ^/2E 
criterion  leads  to  approximations  of  best  fit  to  f(t);  within  the  ITnE2  family  of  error 
criteria,  the  IT'^^E2  criterion  leads  to  approximations  of  best  fit  to  f(t),  and;  within 
the  AE  -  ITnAE  family  of  error  criteria,  the  IT’^AE  criterion  leads  to  approximations 
of  best  fit  to  f(t). 

From  the  eleven  selected  error  criteria,  the  IT  ^/2AE  and  the  IT  2E  criteria 
lead  to  approximations  of  best  fit  to  f(t)  [Vig.  4.  3.  7  b|  . 


B.  Approximations  of  best  fit  between  |  F^  (jip  )  |and  |  F  (jio  )  |  :  Within  each  family 

of  error  criteria,  weighting  small-time  heavily  leads  to  approximations  having  the 
best  fit  between  |Fa(jw)|  and  [F(jw)|  (Fig.  4.3,8a).  More  specifically,  within  the 
ITnE  family  of  error  criteria,  the  IT-1/2E  criterion  leads  to  approximations  of  best 
fit  between  [  F&  (jto)|  and  |F  ( j  co  )  |  ;  within  the  ITnE2  family  of  error  criteria,  the 
IT’l/2E2  criterion  leads  to  approximations  of  best  fit  between  |  F&  (ju>)|  and  |F  (j<o)|, 
and;  within  the  AE-ITnAE  family  of  error  criteria,  the  IT_1/2AE  criterion  leads  to 
approximations  of  best  fit  between  j  Fa  (jto  )  |  and  |  F  (jco  )  |  . 

-l/2 

From  the  eleven  selected  error  criteria,  the  IT  E  criterion  leads  to  approxi¬ 
mations  of  best  fit  between  |  F^  ( j u>  )  |  and  |  F  (jto  )  |  (Fig  .  4 . 3  ,8  b)  , 

C.  Approximations  of  best  fit  between  (jto)  and  /F  (jto ):  Within  the  ITnE, 

ITnE2,  and  AE  -  IT^AE  families  of  error  criteria,  the  IE  and  IT  ^2E,  IT  ^2E  ,  and 
AE  criteria,  respectively,  lead  to  approximations  of  best  fit  between^/Fa  (jto)  and 
/F  (jto)  [Fig.  4.3.9a].  " 

-1/2  2 

From  the  eleven  selected  error  criteria,  the  AE  and  the  IT  1  E.  criteria  lead 
to  approximations  of  best  fit  between  /Fr  (jto)  and/F(jto)  |Vig,  4.  3.  9bJ  . 
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D. 


Approximations  having  the  closest  relative-stability  corre spondence  between 
F  (s)  and  F(s):  Within  the  ITnE  and  ITnE  families  of  error  criteria,  weight¬ 


ing  small-time  heavily  leads  to  approximations  having  the  closest  relative-stability 
correspondence  between  Fa(s)  and  F(s).  More  specifically,  within  the  ITnE  and 
ITnE2  families  of  error  criteria,  the  IT 


-1/2  2 

E  and  XT  '  E  criterion,  respectively, 


lead  to  approximations  having  the  closest  relative -stability  correspondence  between 
Fa(s)  and  F(s).  Within  the  AE-ITnAE  family  of  error  criteria,  the  AE  criterion  leads 
to  optimum  approximations  -  -  optimum  in  the  sense  of  the  closest  relative -stability 
correspondence  between  Fa(s)  and  F(s)  [Fig.  4.  3.10a]. 

_l/2 

From  the  eleven  selected  error  criteria,  the  AE  and  IT  '  E  criteria  lead  to 
approximations  having  the  closest  relative- stability  correspondence  between  F  (s)  and 


F(s)  [Fig.  4.3.10b]. 


E.  Approximations  having  the  closest  absolute-stability  (K  >  0)  correspondence 

between  F  (s)  and  F(s):  Within  the  ITnE  and  ITnE  families  of  error  criteria, 

3. 

weighting  small-time  heavily  leads  to  approximations  having  the  closest  absolute- 
stability  correspondence  between  Fa(s)  and  F(s).  More  specifically,  within  the  ITnE 
and  ITnE2  families  of  error  criteria,  the  IT  ^^E  and  IT  ^2E2  criterion,  respectively, 
lead  to  approximations  having  the  closest  absolute  -  stability  correspondence  between 
Fa(s)  and  F(s).  Within  the  AE  -  ITnAE  family  of  error  criteria,  the  AE  criterion  leads 
to  optimum  approximations  -  -  optimum  in  the  sense  of  the  close  st  absolute  -  stability 

4.  3. 11a]  . 

From  the  eleven  selected  error  criteria,  the  AE  and  IT 
approximations  having  the  closest  absolute  stability  correspondence  between  Fa(s)  and 
F(s)[Fig.  4.  3.  lib]. 


1/2f2 


E  criteria  lead  to 


correspondence  between  Fa(s)  and  F(s)  [Fig. 


F.  Approximations  which  are  optimum  in  the,  sense  of  one  or  more  of  the  performance 

measures  listed  in  Fig.  4.  1.  2:  Within  the  ITnE  and  ITnE2  families  of  error 
criteria,  the  1T_^2E  and  IT-*' 2E2  criterion,  respectively,  lead  to  approximations 
which  are  optimum  in  the  sense  of  one  or  more  of  the  performance  measures  listed  in 
Fig.  4.  1.  2  (Fig.  4.  3. 16).  It  would  not  be  fair  to  make  a  similar  statement  for  the 
IT'  _1/2  AE  criterion  without  first  explaining  the  extraordinarily  strong  showing  made  by 
the  AE  criterion. 

The  reason,  for  the  very  strong  showing  made  by  the  AE  criterion,  is  evident 
as  a  comparison  of  Eqs.  (4.10)  and  (4,11)  reveals.  Consider,  for  the  moment,  a  two- 
term  approximation  in  which  the  coefficients  and  have  been  found  by  a  minimization 
of  either  the  AE  in  Eq.  (4.  10)  or  one  of  the  criteria  in  the  ITnAE  family  in  Eq.  (4.11). 
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The  minimization  of  the  AE  actually  involves  a  three-dimensional  computer  scan  of 
the  CQ  -  C|  -  t  space  while  the  minimization  of  the  IT  '  AE,  for  example,  merely 
involves  a  two-dimensional  scan  of  the  CQ  -  space  f  It  would  appear  from  this 
and  the  results  of  Fig.  4.  3.16a  that  the  extra  dimension  involved  in  the  minimization 
of  the  AE  criterion  is  sufficient  to  enhance  the  selectivity  of  this  criterion;  however, 
the  IT  /^AE  criterion  still  leads  to  15%  more  of  the  "  optimum  approximations"  ,  on 
the  average,  then  the  AE  criterion  does,  as  is  borne  out  on  (a)  of  Fig,  4.  3.  16. 

From  the  eleven  selected  error  criteria  the  IT  ^^E,  IT  ^  E  ,  AE,  and 
IT  -V2ae  criteria  lead  to  approximations  which  are  optimum  in  the  sense  of  one  or 
more  of  the  performance  measures  listed  in  Fig.  4.  3.  6.  V/kile  a  selectivity  of  error 
criteria  exists  on  the  "family  of  error  criteria"  level,  this  selectivity  no  longer  seems 
to  exist  when  the  sample-space  is  extended  to  all  eleven  error  criteria.  Based  upon  the 
summary  in  Fig.  4.  3.18,  for  the  three  term  approximations,  and  the  results  presented 
in  A  through  E,  on  the  preceding  pages,  one  is  led  to  the  conclusion  that  the  IT  E 
and  the  AE  criterion  seem  to  be  the  most  selective  error  criteria;,  they  lead  to  approxi¬ 
mations  that  are  optimum  with  respect  to  more  of  the  performance  measures  listed  in 
Fig.  4.  3.  6  then  do  the  other  nine  error  criteria. 

G.  Common  properties  of  the  error  criteria  in  A  -  F,  on  the  preceding  pages: 

The  results  in  A-F,  on  the  preceding  2  page s  clearly  indicate  that  it  is,  in  most 
cases,  the  same  weighting  function  that  these  error  criteria  have  in  common.  The  im¬ 
portant  fact,  however,  is  not  that  the  common  weight  is  ~j=^= —  but  rather  that  empha¬ 
sizing  small-time  heavily  leads  to  optimal  approximations.  This  seems  plausible, 
since  many  of  the  performance  measures  in  Fig.  4.  3.  6  involve  the  concept  of  stability 
which,  as  has  been  pointed  out  in  Section  2.  1,  is  intimately  connected  with  high-frequency 
behavior  or,  by  the  Initial  Value  Theorem,  with  small-time  behavior. 

H.  Approximations  of  incorrect  asymptotic-order:  From  the  large  amount  of  pro¬ 

cessed  and  evaluated  data  involved  in  this  study  it  was  possible  to  conclude  that,  on  the 
average,  the  numerical  values  of  the  error  between  the  actual  loop  gain  necessary  to 
achieve  a  specified  c(t)  and  the  loop  gain  required  by  the  approximate  plant  to  achieve 
the  same  closed-loop  response  were  smaller  for  the  approximations  of  correct 
asymptotic -order  than  they  were  for  those  of  incorrect  asymptotic-order. 

As  an  example,,  consider  the  plant  f(t)  =  e  -  e  ^  and  the  loop  gain  required 
to  cause  the  closed-loop  response  c(t),  in  Fig.  4.  3.  4,  to  oscillate  with  a  damping 

>j<  For  an  extensive  discussion  of  multi-dimensional  computer  scanning,  see 
Appendix  C. 
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ratio  £  =  0.  707.  The  loop  gain  required  of  the  output  of  the  system  for  it  to  oscillate 

with  £  =  .  707,  when  the  actual- plant  is  embedded  in  the  forward  path  in  Fig.  4.  3.  4a, 

is  K  =  5.  The  loop  gain  closest  to  the  actual  gain  of  K  =  5,  when  A.  O.  (F  )  =  2  in 

2  a 

the  system  of  Fig.  4.  3.  4b,  is  produced  by  the  ITE  approximation  listed  in  Table  D.  11, 

and  is  K  =  4.  63.  The  loop  gains  closest  to  the  actual  gain,  when  A.  O.  (F  )  =  1  and  3, 

~l/2  -l/2  2  a 

on  the  other  hand,  are  produced  by  the  IT  '  E  and  IT  '  E  approximations  listed  in 
Tables  D.  4  and  D.  14  respectively  and  are  K  =  2.  6  and  K  =  2.  88.  In  this  case  the 
superiority  of  the  approximation  of  correct  asymptotic-order  as  compared  to  those  of 
incorrect  asymptotic-order  is  quite  obvious. 
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CHAPTER  5.  CONCLUDING  THOUGHTS  AND  RECOMMENDATIONS 


The  primary  purpose  of  the  research  described  in  the  preceding  chapters  was 
to  investigate  some  of  the  considerations  which  influence  the  choice  of  method  for  the 
identification  of  signals  in  the  time-domain.  Particular  attention  has  been  given  to 
the  asymptotic-order  of  the  approximation,  weighting  functions,  and  the  choice  of  a 
suitable  error  criterion. 

It  has  been  shown,  in  Chapters  1-3,  that  the  sets  of  orthonormalized  exponential 
approximants  developed  by  Huggins^,  Kautz^,  and  Braun^,  whose  asymptotic-order, 
in  the  s-domain,  is  unity,  are  not  always  applicable  to  the  "identification"  of  a  process 
which  is  embedded  in  the  forward  path  of  a  positional  servomechanism.  Stability  con¬ 
siderations,  in  many  instances,  necessitate  the  use  of  approximants  of  asymptotic- 
order  greater  than  unity;  such  approximants  are  developed  in  the  first  three  chapters. 

It  has  also  been  shown  that  weighting  small-time  heavily  leads  to  approximations 
(of  a  process)  which  satisfy  many  of  the  performance  criteria  necessary  for  not  only  a 
close  correlation  between  the  approximations  and  the  process  in  the  time-domain  but 
also  for  a  close  correlation  between  the  approximations  and  the  process  in  the  s-domain, 
the  latter  correlation  being  very  important  when  the  identification  of  the  process  is 
merely  the  first  step  in  an  analysis  of  a  closed-loop  servo  in  which  the  process  is 
embedded. 

Rather  than  formally  summarize  all  of  the  results  of  the  preceding  four  chapters* 
some  of  the  problems  which  remain  to  be  investigated,  many  of  which  are  natural  ex¬ 
tensions  of  these  results,  shall  briefly  be  indicated. 

1.  The  importance  of  matching  the  asymptotic-order  of  the  process  being 
identified  has  been  demonstrated  throughout  Chapters  1-4.  The  determination  of  the 
asymptotic-order  of  a  process  from  practical,  experimental,  time-domain  measure¬ 
ments  made  upon  the  process,  under  the  assumption  that  the  process  may  be  repre  - 
sented  by  a  lumped-parameter  model,  remains  one  of  the  most  challenging  problems 
facing  the  analyst. 

2.  The  approximants  developed  in  Chapters  1  and  3  are  useful  in  the  identifi¬ 
cation  of  overdamped  processes.  The  extension  of  these  results  to  the  underdamped, 
or  complex-pole  case,  if  at  all  possible,  would  be  of  interest,  since  many  systems  are 
indeed  characterized  by  underdamped  impulse  responses.  At  the  same  time,  the 
feasibility  of  using  complex-pole  approximants  should  be  investigated;  they  generally 
lead  to  much  greater  computational  difficulties,  as  compared  to  the  real-pole  approxi¬ 
mations. 
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3.  The  matrix  weighting  function  developed  in  Appendix  B,  in  connection 
with  the  pole- spacing  question,  while  attractive  on  the  one  hcind,  in  that  it  enables 

one  to  obtain  unevenly- spaced  poles  in  F_^(s),  involves  an  excessive  amount  of  compu  - 
tational  effort,  on  the  other  hand.  Might  this  difficulty  be  overcome  by  adapting  the 
matrix  weighting  function  to  a  computer  solution  of  the  problem? 

4.  Weighting  small-time  heavily  is  important  in  the  solution  of  the  identifi¬ 
cation  problem  in  adaptive  systems.  The  possibility  of  extending  the  discussion  of  the 

-k  kj  t  /  -k1  t\k2 

weighting  function  e  V  1  -  e  J  to  negative  values  of  would  provide  one 

with  a  basis  for  extending  the  results  of  Chapters  1  and  3  to.*orthonormal  exponential 
approximants  -  -  approximants  which  are  weighted  most  heavily  for  very  small  time  -- 
of  any  asymptotic-order.  These  approximations  would  then  be  consistent  with  the 
requirements  demanded  in  the  solution  of  the  identification  problem  in  adaptive  control 
systems. 

5.  Based  upon  the  "small-time"  weighting  results  of  Chapter  4,  one  must 
ask  whether  or  not  it  is  possible  to  develop  analytical  solutions  of  the  identification 
problem  which  are  based  upon  error  criteria  incorporating  weights  of  the  form 

_  J_ 

t  n  ,  n  =  2,  3,  4 . If  this  could  be  done  then  it  might  be  possible  to  substanti¬ 

ate  (or  disprove)  theoretically  the  results  of  that  chapter. 

6.  The  results  of  Chapter  4  were  based  upon  a  set  of  performance  measures 
suited  to  single-loop  feedback  control  systems.  Given  a  particular  application  (network 
synthesis,  stability  analysis,  adaptive  control,  etc.),  the  determination  of  what  consti¬ 
tutes  an  optimum  set  of  performance  measures  which  the  approximation  must  satisfy 

in  order  for  it  to  "best"  represent  the  time  signal  remains  to  be  answered.  These 
sets  of  performance  measures  will  most  likely  be  different  for  each  application. 

7.  Based  upon  the  results  of  item  6  above,  one  could  ask  what  the  optimum 
weighting  function  to  be  used  in  each  application  should  be. 

8.  The  determination  of  the  coefficients  C,  in  the  approximation  f  (t)  = 

m  K  n  . 

V  ,  C,  cj),  (t),  using  an  error  criterion  from  within  the  AE  -  IT  AE  family  of 
k^O  k  k 

error  criteria,  involves  multi-dimensional  computer  scanning  techniques,  as  discussed 
in  Appendix  C.  Bellman1  s  Dynamic  Programming34  might  provide  a  useful  alternate 
approach  to  the  problem  of  the  determination  of  the  C^,  in  contrast  to  the  more  direct 
approach  described  in  Appendix  C.  The  dynamic  programming  approach  would  lead 
to  a  complete  set  of  one,  two,  and  three  term  approximations  naturally,  due  to  the 
very  nature  of  the  dynamic  programming  approach. 
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24  19 

9.  Reiss  and  Leight  7  have  investigated  the  optimum  pole  locations  for 

the  poles  of  Fa(s)  when  f (t)  =  e  mt.  The  choice  of  these  optimally  located  poles 

depends  upon  a  priori  knowledge  of  a  range  over  which  the  pole  of  F(s)  is  known  to 

2, 

vary,  and  upon  a  minimization  of  min  (IE  )  with  respect  to  the  poles  qq  ,  . 

of  Fa(s)  .  An  extension  of  their  results  to  more  complicated  processes  would  be  in¬ 
valuable.  Since  it  has  been  shown  that  weighting  small-time  heavily  leads  to  approxi¬ 
mations  which  "best"  represent  the  actual  process,  for  the  positional  servomechanism 
application,  it  would  be  very  valuable,  to  the  control  analyst,  to  know  the  optimal 
pole  locations  of  the  poles  of  Fa(s),  where,  in  this  case,  these  locations  would  be 
determined  in  part  by  minimizing  an  error  criterion,  weighted  heavily  for  small  time, 
with  respect  to  the  poles  of  Fa(s). 

The  solutions  to  these  problems  should  throw  considerably  more  light  upon  the 
overall  identification  problem. 

It  is  hoped  that  if  anything  at  all  has  been  achieved  in  this  dissertation,  it  has 
been  to  make  the  reader  aware  of  the  distinction  that  exists  between  the  "approximation 
in  the  time -domain"  problem  and  the  "identification  in  the  time -domain"  problem. 

In  an  area  such  as  Numerical  Analysis  the  analyst  is  often  interested  in  "approxi¬ 
mating"  a  signal.  He  does  this  by  choosing  an  approximation,  f a(t) ,  such  that  the  fit 
between  fa(t)  and  f (t)  in  the  time -domain  is  close.  The  systems  engineer,  on  the  other 
hand,  "identifies"  a  process.  He  does  this  by  choosing  an  approximation,  f a(t) ,  such 
that  there  not  only  is  a  close  correspondence  between  fa(t)  and  f(t)  in  the  time -domain, 
but  such  that  there  is  also  a  correspondence  between  f a(t)  and  f(t)  in  the  s-domain. 
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APPENDIX  A.  COMPLETENESS  AND  THE  CHOICE  OF  THE  a, 


Definition.  When  lim  (min  IE  )  =  0  for  any  square  integrable  <j)  (t),  one  says  that 

oo  2Q 

the  set  (t)|^  _  q  is  closed  in  the  space  of  all  square  integrable  functions  over  the 

interval  t  e  (0,oo).  The  notation  (0,oo)  is  shorthand  for,  "the  space  of  all  square 
integrable  functions  over  the  interval  t  e  (0,oo)"  . 

°°  20 

Definition.  A  set  j<|>^  (t)j.  ^_q  is  complete  in  L2  (0,oo)  if  no  non-zero  element 
exists  which  is  orthogonal  to  every  other  element  of  that  set. 

Theorem  A.  1  Any  arbitrary  orthogonal  system  fij>^  (t)}  q  in  L?  (0,  co)  is  capable  of 
being  completed  to  an  orthogonal  system,  which  isxomplefe  in  L^fO.oo)!. 

Theorem  A.  2  A  system  of  functions  of  (0,  oo)  is  closed  if  and  only  if  it  is  complete*'. 

Alexits*  summarizes  these  concepts  in  two  profound  sentences. 

The  completeness  of  an  orthonormal  system  is  of  great  consequence  for  the 
theory  of  convergence  of  orthonormal  expansions.  For  instance,  assuming  the 
expansion  of  a  given  L2  (0,oo)  -  integrable  function  f (t)  in  the  functions  of  an 
appropriate  orthonormal  system (tjj.^  _  q  to  be  convergent,  it^i s  ensured  only  by 

the  completeness  of  this  system  that  the  sum  of  the  expansion  C ^  (j>^  (t)  should 

represent  f(t)  almost  everywhere.  I  =  0 

If  the  (t)  are  formed  from  an  exponential  set  of  functions  then  alternate 
statements  comparable  to  the  two  definitions  and  two  theorems  above  can  be  made. 

Szaz's  Theorem  summarizes  these  statements. 

Theorem  A.  3  (Szaz1  s  Theorem^)  If  (j>^  (t)  is  a  linear  combination  of  the  elements 

{-a,  tl  ^  >!< 

e  c  jp _  o  >  0,  such  th^.t  A.  O. 

then  the  set  {  <t>„  (t)l  n  is  closed  in  L-,  (0,co)  if  and  only  if  the  series  S  -5^ - —  , 

L  m=0  l+|a  I 

diverges.  1  no  ' 


*  min  IE 


=  /  w(t)f  (t)  at  -  V  c‘ 

o  k=  0 


The  theorems  in  this  section  will  be  stated  without  proofs.  Their  proofs  can  be 
found  in  the  references. 

###  Generally  speaking,  the  notation  implies  that  a  is  a  function  of  k.  As  an  ex¬ 
ample  a,  could  be  chosen  to  be  k  +  2.  In  this  case  a  =  2,  a,  =  3, . 

.  ,  k  o  1 

S  =  t  +  2. 
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Thus  one  sees  that  he  is  not  completely  at  liberty  in  choosing  the  sets  of  a, 

20  “ 

The.  set  must  satisfy  the  above  theorem.  Liu  has  extended  this  result  to  the  case 
where  A.  O.  )  >  2  . 

Theorem  A.  4  (Generalized  Szaz  Theorem)  If  4>^  (t)  is  a  linear  combination  of  the 

elements  from  a  set  of  exponential  functions  {e  Mk.0.  >o,  such  that  A.  O.  ($  ) 

co  t 

>  2,  then  the  set|ij>^  (t)j°°  is  closed  in  (0,oo)  if  and  only  if  the  set  (t)j-^  ^ 

formed  from  the  same  exponential  set,{e  k  .  ,  such  that  A.  O.  ($  )■  =  1,  is  close 


|(j>^  ( t)^.00  is  closed  in  L^  (0,oo)  if  and  only  if  the  set  (t)j^  ^ 

:  exponential  set,{e  k  ^  ,  such  that  A.  O.  (9?^)  =  1,  is  closed 


in  (0,  oo)  . 


This  means  that  the  same  sets  of  can  be  used  to  generate  the  orthonormal 
approximants  $g(s)  of  any  asymptotic-order. 

By  applying  the  integral  test  to  the  infinite  series  in  Szaz1  s  Theorem  one 
arrives  at  a  more  manageable  test  for  determining  whether  or  not  the  series  in  Theorem 
A.  3  diverges.  s  7  \l/2 


Corollary  A.  1  If  lim  In 
- - -  m~*°o 


/  2 

Q  4-1 
m _ 

4-1 


oo  (a  real  and  positive)then  - 5^-, 

m=  0  l  +  a‘ 


diverges,  and  the  set-j^  (tjj-°°  is  complete' 


Some  complete  and  non-complete  sets  are  listed  below.  In  each  case  the 
validity  of  these  results  can  be  checked  by  applying  Corollary  A.  1  to  the  set  of  a,  . 

a.  Complete  sets 

1.  (  1  4-  bk)V  ,  v  =  1,  2,  3,  .  .  .  k  =  0,  1,  2,  .  .  and 

b  is  an  arbitrary  positive 

2.  a,  =  a  bK  constant. 


1. 

Qk  = 

aQ  (  1  +  bk) 

2. 

ak  = 

,  k 
a  b 

0 

3. 

Qk  = 

aQ  (  1  +bk)k 

4. 

P 

n 

II 

a(14-  bk)'k 

a 

5. 

ak  = 

In  (e  °  4-  bk) 

b.  Non-complete  sets 

1.  a,  =  a  (1  4-  bk] 
k  o 


2.  a,  =  a  b 
k  o 


v  =  1,2,  3, 


k  =  0,  1,  2,  ....  and  b 
is  an  arbitrary  positive 
constant. 
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APPENDIX  B.  MATRIX  WEIGHTING  FUNCTIONS  AND  SPACINGS  OF  POLES  OF  F  (s) 
_ _ _ ^ _ '  a'  ' 

2 

In  this  appendix  the  IE  criterion  is  generalized  to  a  matrix  criterion  by  weight¬ 
ing  each  element,  (j)^(t),  differently  in  Eq.  (1,  3).  The  individual  weighting  of  the  <j>.  (t) 

'is  achieved  by  introducing  the  concept  of  a  matrix  weighting  function.  The  approximation 
n  2 

C,  <)>,  (t)  is  then  reinterpreted  in  the  light  of  the  matrix  IE  criterion  and  the  matrix 
k=0  k  k 

weighting  function.  The  theory  is  then  applied  to  the  exponential  approximation  where, 
in  particular,  the  spacing  of  the  poles  of  Fa(s)  is  investigated.  It  is  shown  that  the 
introduction  of  a  matrix  weighting  function  allows  one  to  achieve  pole- spacing s  in  Fa(s) 
other  than  the  equally- spaced  type  of  pole-spacing  which  the  approximations  discussed 
in  Chapters  1  and  3  are  restricted  to  have. 

B.  1  The  Matrix.  Weighting  Function  Defined. 

—  ' 

W(t)  is  defined  as  an  (n  +  1)  x  (  n  +  1)  symmetrical  matrix  weighting  function 


'oo 

woi  •  • 

.  w0.  .  . 

»  wA 
On 

'io 

W11  •  • 

.  wtj  .  . 

•  w. 

In 

'iO 

Wil  •  • 

.  w .  .  .  . 
1J 

.  w. 
m 

nO 

Wnl  •  • 

.  w  .  .  . 

nJ 

.  w 

n  n 

whereupon  Eq.  (1.  3)  can  be  written  as 


dt  = 


fi.. 

U 


(B.  1) 


(B.  2) 


(B.  3) 


*  The  overbar  indicates  a  matrix  while  no  overbar  indicates  an  element  of  a  matrix. 

**  In  general,  w.  .  is  a  function  of  i,  j,  and  t.  The  t  dependence  is  omitted  in  order  to 
simplify  the  notation. 

***  is  the  (n+1)  x  (n+1)  identidy  matrix. 
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Here  (}>.  and  4)^  are  (n  +  1)  x  (n  +  1)  diagonal  matrices. 

r  *0 


For  clarity  Eq.  (B.  3)  is  written  in  expanded  form,  using  Eqs.  (B.  1)  and  (B.  4),  in 
Eq.  (B.  3a)below. 


oo 

o 


I 


2 

00  0J  vn  On 


(b.  d>_  W.-.  .  •  <b.  <b.  w..  .  .  cb.  <b  w 

Ti  T0  lO  Ti  Tj.  ij  Ti  Yn 


6  cbA  w  .  A  A.  w  . 
m  nO  Yn  nj 


x2 

♦n  Wv 


dt  =  a.j  (B.  3a) 


In  addition,  if  W  is  decomposed  into  the  product  of  an  (n  +  1)  x  1  column  matrix,  W^,  , 

and  a  1  x  (n  +  1)  row  matrix,  W -  ,  in  that  order,  where 

K. 


w. 


w. 

i 


and  W 


R 


[w0 


,  w1  ,  .  .  Wj,  .  .  ,  w 


.] 


(B.  5) 


*  j  M 

r  P  „  . 


dt  implies  that  every  element  in  the  matrix  is  integrated  between  the  limits 


from  0  to  to. 
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so  that 

w  =  wc  WR  (B.  6) 

then  Eq.  (B.  3)  can  be  written  as 
00 

f  (<t>;  wt)  (+j  w a)  dt  =  fj..  (B.  7) 

By  introducing  the  matrix  weighting  function  it  has  been  possible  to  rewrite 
Eq.  (1.  3)  in  a  form  where  each  element  (t)  is  weighted  by  a  different  weighting 
function,  (t).  The  parentheses  in  Eq.  (B.  7)  imply  that  w^U)  is  to  be  associated 
with  c|).  (t)  and  vice-versa.  The  significance  of  the  matrix  weighting  function  on  the  IE^ 
criterion  is  discussed  in  the  following  section. 
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2 

B.  2  The  IE  Redefined  as  a  Matrix  Error  Criterion 

In  the  light  of  the  matrix  weighting  function  Eq.  (B.  I)  it  can  be  shown  that  the 

integral-squared  error  criterion  ^Eq.  (1.  1)  j  becomes  a  matrix  criterion.  All  of  the 

results  obtained  by  minimising  Eq.  (1.1)  hold  in  this  case  also  provided  one  replaces 

f  (t)  by  (f  ).'.  and  C,  by  (C,  )..  in  Eqs.  (1.1),  (1.2)  and  (1.4).  f  and  C,  are  both 
a  -a  ij  K  k  ij_  a  K 

(n  +  1)  x  (n  +  1)  matrices  since  W  is  (n  +1)  x  (n  +  1). 

By  postulating 

?  00  r 

<IE  >ij  =  /  [£  -  (£a>ij]  -ij  dt 

where 


(f,  )f=  =  f.  (C,  )..  A, 
a  1J  k=o  k  1J  h 


(B.  10) 


Eqs.  (1.  2)  and  (1.  4)  become 


?  00  ?  r  -  < 

(min  IE  ). .  =  f  f  w..  dt  -  V  (C.  )  . . 

Jo  «  k^'o  L  k  lJ  J 

00 

(C.  )..  =  f  f  w..  d>i  dt 

k  ij  . I  ij 


(B.  11) 

(B.  12) 


An  example  will  clarify  the  meaning  of  the  subscripts  in  these  equations. 
Example. 

Consider  a  two-term  approximation  -  -  n  =  1. 

_  1  _ 

fa  =  .  X  .  Ck  *k  =  C0  *0  +  C1  *1 

k  =  0 

W,  in  this  case,  is  a  2  x  2  matrix 


(B.  13) 


(B.  14) 


*  To  simplify  the  notation  the  t  dependence  is  not  indicated  but  is  to  be  understoo< 
■fVf  The  meaning  of  a  matrix  approximation  will  be  clarified  in  the  next  section. 
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The  addition  of  a  third  term  to- the  approximation  f  not  only  adds  a  third  term 
to  Eq.  (B.  13),  but,  what  is  more  important,  also  increases  the  dimensionality  of  all 
of  the  matrices  in  Eqs.  (B.  14)  (B.  15),  (B.  16),  (B.  17),  (B.  18)  and  (B.  19)  from  two  to 
three.  This  obviously  occurs  because  each  one  of  these  is  an  (n  +  1)  x  (n  +  1)  matrix, 
(n  +  1)  being  the  number  of  terms  in  the  approximation  Eq.  (B.  10). 

That  f^,  and  (min  IE^)  are  symmetrical  matrices  is  obvious  from  their 
dependency  upon  W  which  is  symmetrical|"Eq.  (B.  2)1  . 
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B.  3  The  Meaning  of  a  Matrix  Approximation 

It  has  developed  that,  by  weighting  each  one  of  the  approximants  c|>^  (t)  differ¬ 
ently,  f  (t)  has  become  a  matrix  approximation  function,  f  (t).  Basically,  however,  one 
seeks  an  approximation  to  f(t)  which  is  not  a  matrix  and,  therefore,  one  must  reinterpret 
fa(t)  in  the  light  of  this  requirement.  To  do  this,  refer  to  the  two-term  approximation 
worked  out  in  detail  in  the  preceding  section.  Eqs.  (B.  17)and  (B.  19)  are  the  important 
re  suits. 

Quite  obviously,  associated  with  each  element  in  f  is  a  corresponding  element 

2  a 
in  (min  IE  ),  and  vice-versa. 

(f  )..  ij  (min  IE2)..  (B.  20) 

a'  tj  -e - »-  'ij 

Due  to  the  individuality  of  the  weighting  functions  w_  (t),  in  Eq.  (B.  17)  will  contain  3 

completely  different  approximations,  (f  ),.  ,  (f  )  ,  and  (f  )  .  Naturally  there  will 

be  a  different  min  IE  associated  with  each  one  of  these  approximations.  If  one  agrees 

2 

that  the  smallest  numerical  min  IE  gives  the  best  approximation,  in  the  sense  of  a  close 

2 

fit  between  f  (t)  and  f(t),  one  must  choose  the  one  approximation  whose  min  IE  is 
3  _ 

numerically  smaller  than  all  others  from  the  elements  of  f  .  This  means  that  one 
seeks  the  absolute  minimum  integral- squared  error  from  a  matrix  of  relative  minimum 
integral- squared  errors,  that  is, 

f  (t)  «  f(t)«e — >  min  (min  IE2) .  .  (B.  21) 

a  ij 


Example  w„  =  w  (t) 

By  choosing  all  of  the  elements  w_  to  be  the  same  function  the  matrix  approxi¬ 
mation  should  degenerate  to  the  non-matrix  version  discussed  in  the  body  of  the  disserta¬ 
tion.  That  this  is  indeed  the  case  follows  directly  from  a  substitution  of  =  w(t)  into 
Eqs.  (B.  12),  (B.  10) ,  and  (B.  11). 


and 


ij 


(fa>.. 
a  iJ 


/ 


f  <{>k  w  dt 


E  (ck>. 


k=  0 


IJ 


n 

k?o 


Clc  *k 


(B.  22) 
(B.  23) 


(min  IE  ) . .  = 
D 


°o 

J  f  w  dt 
o 


(B.  24) 
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From  Eqs.  (D.  2.5)  and  (B.  24)  it  is  obvious  that  all  o£  the  elements  in  f.  are  identical 

2  a 

and  all  of  the  elements  in  (min  IE  )  are.  identical.  One  then  argues  that  it  doesn1  t 
matter  which  approximation,  (f  )  ,  is  chosen  to  represent  f(t)  since,  they  are  all  the 

a  'j 

same.  Thus  one  sees  that  the  maLrix  approximation  reduces  to  the  non-matrix  approxi¬ 
mation  when  Eqs.  (B.  12),  (B.  10)  and  (B.  11)  can  be  written  as 


C,  =  G,  U 
k  k 


f  =  f  U 
a  a 


(B.  25) 

(B.  26) 


and 


(min  IE2) 


(min  IE2)  U 


(B.  27) 


where  U  is  the  unit  matrix. 
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B.  4  <|>k  (t)  :  The  Exponential  Set. 

Comparing  Eqs.  (3.  2)  and  (B.  7)  one  obtains  the  following  recursive  equation 
for  the  (j)^  (t)  in  terms  of  the  Jacobi  Polynomials  and  a  weighting  function  that  is  not  only 
a  function  of  time  but  is  also  a  function  of  k  : 

-*2-t  ^ 


*k(t>  =  (-i)k  /£  £— 

V  k  Wk(t) 


(a,  c;  e  pt) 


(B.  28) 


2 

The  properties  of  c|)k(t)  when  w^  (t)  =  1  and  wk(t)  =  e  (v L  -  e  are 

discussed  in  chapters  1  and  3  respectively  of  this  dissertation.  To  indicate  what 
happens  to  the  spacing  of  the  poles  of  Fa(s)  when  a  weighting  function  is  chosen  that  is 
a  function  of  k,  consider 


(t)  =  e 


(B.  29) 


From  Eqs.  (B.  29)  and  (B.  28) 


<k(t)  =  (-D 


;[!-ww]p.^ 


(a,  c;  e  'pt) 


(B.  30) 


This  weighting  function  does  not  affect  the  results  of  Theorem  1  for  A.  O.  ($k )  . 
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B.  5  The  Spacing  of  the  Poles  of  fl^s)  and  F^  (s). 


Theorem  2(B)  The  poles  of  the  $k(s)  are  located  along  the  negaLive  -  real  axis 
in  the  s-domain  at  -|q  +  ^  -  w  (k)j  p  where  0  ^  q  <  A.  O.  (a?^)  +  k  -  1  and  is  integral. 
These  poles  are  spaced  p  units  apart. 

One  sees  that  while  the  location  of  the  poles  of  ^(s)  is  now  dependent  upon  k 
their  spacing  still  is  constant.  The  spacing  of  all  the  poles  of  Fa(s),  however,  is  not 
necessarily  uniform.  As  a  matter  of  fact  Fa(s),  which  is  simply 

Fa<s>  =  JL  CkVS>  <B‘31> 

k  =  0 

will  contain  (n  +  1)  unevenly- spaced  clusters  of  equally- spaced  poles.  Fig.  (B.  5.  1) 

illustrates  this  behavior  for  a  three  term  aj.  oroximation  where  A.  O.  ($.  )  =  2,  p  =  1, 

2  k 
c  =  2  and  w(k)  =  -  (k  +  1)  .  The  negative  sign  in  w(k)  is  necessary  if  all  the  poles  of 

F  (s)  are  to  be  in  the  left-half  of  the  s-plane. 

Properly  choosing  w(k)  allows  one  to  achieve  a  variety  of  spacings  for  the  pole 
clusters  which  appear  in  Fa(s).  One  measure  of  this  spacing  is  the  distance  from  the 
center  of  one  cluster  to  the  center  of  an  adjacent  cluster.  In  this  case,  it  can  be  shown 
that  w(k)  must  satisfy  the  finite  difference  equation. 

w  (k  +  1)  -  w  (k)  =  A£  +  4-  (B.  32) 

P  z 

where  AC  is  the  centroidal- spacing  of  adjacent  clusters.  Table  B.  5.  1  presents  a  number 
of  w  (k)  which  were  obtained  as  the  solutions  of  Eq.  (B.  32)  for  the  AC  listed  in  the  first 
column  of  that  table.  With  this  type  of  spacing  it  is  possible  to  lose  the  identity  of  the 
clusters  since  overlapping  of  the  poles  in  adjacent  clusters  may  occur;  thus,  the  poles 
of  Fa(s)  will  appear  to  be  une venly- spaced. 

On  the  other  hand,  if  it  is  desirable  to  maintain  the  identidy  of  each  one  of  the 
clusters  then  the  results  summarized  in  Table  B.5.2  should  be  used  for  w(k)  in  the 
equation  for  the  approximants  <j>^  (t),  Eq.  (B.  30).  Here  w  (k)  is  determined  from  the 
condition  that  the  distance  between  the  pole  furthest  to  the  left  for  one  cluster  and  the 
pole  furthest  to  the  right  for  a  second  cluster,  adjacent  to  the  first  on  the  left,  be  spe¬ 
cified  as  AD.  This  condition  can  be  expressed  mathematically  j^from  the  results  of 
Theorem  2  (B)j  as 


w  (k  +  1)  -  w  (k)  = 


AD 

P 


-  k  +  1  -  A.  O.  ($k ) 


(B.  33) 


Ill 


The  type  of  pole- spacing  obtained  through  the  use  of  the  w  (k)  from  Eq.  (B.  33) 
is  useful  if  one  has  a  vague  idea  of  the  pole  locations  of  F(s).  By  spacing  the  pole 
clusters  of  Fa(s)  at  these  locations  it  may  be  possible  to  improve  the  overall  identifi¬ 
cation  of  f  (t) ,  as  measured  by  the  performance  criteria  listed  on  Fig.  4.  3.  6. 

It  is  important  to  remember  that  the  results  of  this  section  are  based  upon  the 
choice  of  the  weighting  function  e  w  (^)  P*-  jn  the  preceding  section,  and  that  they  can 
be  rederived  for  other  weighting  functions  as  well.  It  is  also  important  to  remember 
that  the  two  types  of  pole  cluster-spacings  discussed  in  this  section  -  -  the  centroidal 
spacing  and  the  non-overlapping  spacing  -  -  are  not  the  only  types  of  pole  cluster- 
spacings  that  one  might  consider.  Once  a  criterion  for  the  pole  cluster-spacing  has 
been  decided  upon  by  the  analyst,  a  finite  difference  equation,  similar  to  Eqs.  (B.  32) 
and  (B.  33)  will  result,  from  which  he  can  solve  for  w(k).  In  short  then,  the  results 
of  this  section  and  the  last,  Section  B.  4,  have  merely  indicated  the  significance  of  a 
matrix  weighting  function  on  the  pole-spacing  of  the  poles  of  Fa(s),  for  a  very  special 
weighting  function  and  for  special  prechosen  spacings  of  the  pole  clusters  of  Fa(s). 
These  results  can  be  extended  in  many  directions,  as  indicated  at  the  beginning  of  this 
paragraph. 


Table  B.  5.  1  Summary  of  Results  for  the  Pole  Cluster-Centroidal  - 
Spacing  Design. 


AC 

* 

w  (k)  -  w  (o)  jw(o)  < 

-kp 

k  (~  -  K) 

-k  K  p 

.  ,2 

—  (  1  +  K)  -  —  K 

2  2 

-(k  +  |3)2  Kp 

k  i.  -  K  (p2  -  p  +  j-).  -  k2  K  (p  -  y)  -  k3 

-  e|ik  Kp 

>!<  w  (o)  <  ^  ensures  one  that  all  of  the  poles  of  Fa(s)  are  in  the  left-half  of  the 
s -plane,  for  all  k. 


1.12 


Table  B.  5.  2.  Summary  of  Results  for  the  Pole  Cluster  - 
Non-Overlapping  Design. 


AD 

w  (k)  -  w  (o)  w  (o)  <  ^ 

-  KP 

k 

3  112 

2  -  I"  k 

-k  K  p 

k 

2 

A.O.  ($k)  -  3  -  k]  -  ~  (K  +  1)  k2 

-  (k  +  p)2  Kp 

k 

|  -  A.O.  ($k)  -K  (P2  -P  +  1-)  -  k2 

—  +  K  (P  -  — )  -  —  k3 

2  2  J  3 

-  C|xkKp 

k 

'3  -  A.O.  («)1  -  >  *2-k(‘  Vk-1) 

.2  kJ  2  Ve|x  -  1  / 

w(o)  <  —  ensures  one  that  all  of  the  poles  of  F  (s) 

2  a 

s -plane,  for  all  k. 


are  in  the  left-half  of  the 
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APPENDIX  C.  THE  TWO-DIMENSIONAL  APPROXIMATION  PROBLEM  AND 
THE  ASSOCIATED  TWO-DIMENSIONAL  SCANNING  ON  A  DIGITAL  COMPUTER 


C.  1  Introduction 

N  "mk  * 

In  this  appendix  two-term  approximations  of  the  signals  /  A,  e 

k  =  0  k 

(m^  real),  determined  from  a  minimization  of  any  one  of  the  error  criteria  in 
the  AE  -  ITn  AE  criteria  family,  are  investigated;  the  approximations,  f a( t) ,  are  of 
the  form 

-at  “  a  t 

fa(t)  =  B  c  °  +  C  e  (C.l) 

For  convenience  Eqs.  (4.  3)  and  (4.4),  which  define  the  AE  and  the  ITn  AE  criteria 
respectively,  are  repeated  below. 


A  E  =  max 

f  -  f 

a 

(4.3) 

t 

( 

ITn  AE  =  I 

X) 

r  tn 

f  -  f 

dt 

(4.4) 

J 

o 

a 

From  Eqs.  (C.  1),  (4.  3),  and  (4.  4)  one  sees  that  the  AE  criterion  is  a  function 
of  three  variables  B,  C,  and  t,  while  the  ITn  AE  criteria  are  functions  of  only  B  and  C. 
To  distinguish  between  the  two  cases,  the  following  notation  is  introduced: 

AE  =  max  E  (B,  C,  t)  =  E  |'B,  C,  t^  cj  (C.  2) 

and 

ITn  AE  =  E'  (B,  C)  (C.  3) 

where  t  ^  „  is  the  time  at  which  the  absolute  maximum  of  the  AE  occurs.  The 
subscript,  '  B,  C  indicates  that  this  time  is  also  a  function  of  the  values  B  and  C  assume. 
Figure  C.  1.  1.  illustrates  the  relationship  of  t  ^  c  to  the  AE  for  the  arbitrarily  chosen 
values  of  B  =  B^  and  C  =  C^  . 

Since  an  extra  dimension  is  involved  in  the  AE  criterion  we  shall  first  concentrate 
on  its  minimization.  The  reduction- of  the  AE  minimization  techniques  to  techniques  . 
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the  minimization  of  a  criterion  from  the  ITn  AE  criteria  will  then  follow 


i  E  (Bj  ,  Cj  ,  t) 
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C.  2  Mathematical  Formulation  of  the  AE  Minimization 

Values  of  t,  B,  and  C  are  sought  such  that  max  E  (B,  C,  t)  is  a  minimum  with 
•respect  to  B  and  C,  that  is,  it  is  desired  to  find 


min  max  E(B,C,t)  =  min  E|B,C,t 


The  numerical  value  of  Eq.  (C.  4)  will  be  designated  as  min  AE. 

B,  C 

Maximizing  E(B,C,t)  with  respect  to  t  is  accomplished  by  differentiating  it 

partially  with  respect  to  t,  setting  the  result  equal  to  zero,  and  solving  the  resulting 

equation  for  the  time  at  which  the  absolute  maximum  of  E  (B,  C,  t)  occurs.  If  this  time 
M 

is  denoted  t^  ^  then,  it  is  quite  obvious  that,  it  will  be  a  function  of  both  B  and  C, 
that  is, 

t“c  =  f(B,C)  (C.  5) 


whereupon  Eq.  (C.  2)  becomes 


AE  =  E 


B,  C, 


f  (B,  C) 


To  minimize  Eq.  (C.  6)  with  respect  to  B  and  C  one  may  pursue  the  following  course. 
By  differentiating  this  equation  partially  with  respect  to  B  and  setting  the  result  equal 
to  zero  one  should  be  able  to  solve  for  B  in  terms  of  C, 


E  B,  C,  f  (B,  C)] 


=  0  —  B  =  g  (C) 


From  Eqs.  (C.  7)  and  (C.  6)  one  concludes  that 


min  AE  =  Et  g, 
B  l 


(C),  C,  f  [g  (C),  c]  | 


Finally,  min  AE  is  found  by  differentiating  Eq.  (C.  8),  setting  the  result  equal  to  zero, 
B»  C  * 

and  solving  for  C.  Suppose  C  =  rj.  In  this  case 


min  AE  =  E-|g(n),  r ],  f  [g  (rj),  rjj  | 


B  =  g  (rj) 


and 


t  ^  c  =  f  [g  W’  r>’ 
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(C.  11) 


To  perform  the  operations  indicated  in  Eqs.  (C.  5)-(C.  11)  analytically  is  usually 
impossible  in  even  the  simplest  of  cases.  This  is  due  primarily  to  the  facts  that  these 
equations  are  transcendental  and  E(B,  C,  t)  is  the  absolute  value  of  the  error  f(t)  -  fa(t). 
To  solve  this  system  of  equations,  we  turn  to  a  computer  simulation  of  Eq.  (C.  4). 
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C.  3  Computer  Formulation  of  the  AE  Minimization 

The  digital  computer  solution  of  Eq.  (C.  4)  for  B,  C  and  t  _  is  a  discrete 

.D, 

solution  in  contrast  to  the  continuous  type  of  solution  outlined  in  the  preceding  section, 
Before  outlining  the  major  computer  operations  needed  in  the  solution,  one  must  re¬ 
define  the  continuous  variables  B,  C,  and  t  as  discrete  variables.  In  the  discussions 
that  follow  B,  C,  and  t  represent  discrete  sets  of  real  numbers, 


B  = 

w 

,  t 

=  0,1,  2,  .  .  . 

(C.  12) 

C  = 

k) 

,  r 

=■  0,1,  2,  .  .  . 

(C.  13) 

t  = 

{*’} 

.  q 

=  0,1,2,  ..  . 

& 

(C.  14) 

the  e 

lements  b. 

and  c^  may  be  positive,  negative, 

or  zero  while  the 

t4  must  be  positive  or  zero.  Quite  obviously  the  accuracy  of  the  computer  solutions 


will  depend  primarily  upon  the  increments  chosen  for  the  b^,  c^,  and  tq 
purposes  the  increments  Ab  and  Ac  are  chosen  the  same,  hence 


For  practical 


Ab  = 

bf 

■  bf  -i  = 

6 

(C.  15) 

Ac  = 

c 

r 

•  Cr-1  = 

6 

(C.  16) 

At  = 

-  tq'1  = 

T 

(C.  17) 

below. 


The  major  computer  operations,  in  terms  of  this  notation,  are  summarized 

(1)  The  computer  stores  |b^j,  |c  J,  ahd  |t^J  . 

(2)  For  an  element  of  jb^j  ,  say  b^  ,  and  an  element  of  {cr|  ,  say  c^  , 


the 


computer  evaluates  E 
it  stores  these  values. 


3^  ,  c^,  |t^j  for  all  q^where  At  =  T  as  in  Eq.  (C.  17),  and 


(3)  The  data  from  step  (2)  is  scanned  by  the  computer  in  order  to  find 

Since  t^  will  be  a 


M, 


b0'  C4 


E  (b_,  c.,  t  )  which  corresponds  to  max  E 

{tq} 

function  of  the  b  and  c  it  shall  be  designated  as  t 
r  „  i  It  l ,  r 

of 


M 


{■’} 


t?^  must  be  an  element 

t,  r 


*  The  use  of  the  superscript  notation  will  become  lear  in  the  development  of 
this  section. 
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(4)  The  computer  repeats  steps  (2)  and  (3)  for  all  combinations  of  and  c^, 
Naturally,  the  computational  time  in  this  step  will  be  directly  proportional  to  the  incre¬ 
ment  6  chosen  for  the  variables  b^  and  c^  in  Eqs.  (C.  15)  and  (C.  16). 

(5)  The  computer'  scans  the  complete  set  of  stored  numbers  corresponding 
to  max  E  b„,  c  ,  j  t^ )  and  chooses  one  of  these  numbers  as  the  min  AE.  If  this 

q  j  L 1  ,r  1  ,  b,c 

occurs  for  i  =  l  and  r  =  r  ,  for  example,  f&(t)  will  have  been  found  to  be 

-at  -  a.  t 

f  (t)  =  b.t  e  °  +  c  t  e  (C.  18) 

.  a '  '  i  r 

completing  the  problem. 

In  practice,  one  would  like  the  computer  to  complete  these  five  steps  in  a 
minimum  amount  of  time.  For  a  particular  computer,  this  will  depend  upon  the  ranges 
chosen  for  B,  C,  and  t,  the  increments  in  the  b^ ,  c^,  and  tq  ,  and  the  development  of 
a  judicious  implementation  of  step  (4).  In  regards  to  this  last  phrase, ^one  must  admit 
that  it  may  not  be  necessary  to  repeat  steps  (2)  and  (3)  for  all  combinations  of  b^  and 
c^  .  The  problem  is,  given  a  range  for  B  and  C  how  does  one  choose  a  minimum  number 
of  combinations  of  the  b  and  c^  such  that  the  computer  carries  through  the  minimization 
procedure  in  a  minimum  amount  of  time?  The  following  discussion  presents  one  such 


method  for  accomplishing  this. 
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C.  4  A  Practical  Computer  Implementation 

By  reducing  the  three-dimensional  scanning  procedure  outlined  in  the  last 
section  to  a  manifold  of  two-dimensional  scans,  this  scanning  procedure  can  be  system¬ 
atized  in  such  a  manner  that  the  computational  time  will  be. minimized.  This  can  be 
accomplished  by  fixing  either  one  of  the  constants  or  c^  at  the  beginning  of  a  run.. 

By  varying  the  other  constant  over  its  range  in  step  (4)  of  the  scanning  procedure,  one 
will  be  led  to  a  family  of  numbers  from  which  the  computer  will  pick  the  absolute 
minimum  (the  smallest  number).  As  an  example,  suppose  b^  =  b^  has  been  chosen 
ahead  of  time;  it  would  then  represent  a  portion  of  the  solution  of  the  following  two- 
dimensional  discrete  version  of  Eq.  (C.  4); 


r 

(  r  -A  1 

min 

M 

max  E  | 
{*’) 

^4’  Cr’  }) 

(C.  19) 


Associated  with  Eq.  (C.  19)  is  a  value  of  c^  which,  for  example,  might  be  c^  .  This 
procedure  is  repeated  for  the  elements  of  |b^j  until  the  number  in  Eq.  (C.  19)  is  a 
minimum;  thus,  the  numbers  in  Eq.  (C.  19)  represent  the  locus  of  the  relative  minima 
of  |-nax  E^b^,  cri  {  t^}j  ,  bg  fixed  and  c^  variable.  Figure  C.  4.  1  presents  a  typical 
locus,  which,  for  clarity,  is  shown  as  a  continuous  curve.  Actually,  the  locus  of 
relative  minima,  plotted  on  the  b^  -  c^_  plane,  is  a  set  of  discrete  points  whose  b^ 
coordinates  are  spaced  uniformity  -  -  5  units  apart.  Associated  with  each  point  on  the 
locus  is  a  number  from  Eq.  (C.  19).  The  point  (g^q,  bg)  is  assumed  to  represent  the 


4 
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solution  of  the  three-dimensional  discrete  version  of  Eq.  (C.  4), 


min  min  max  E  b,.  c  3/tql 

M  N  M  ' 1  1 1  1 


(C.  20) 


Ox  particular  interest  is  the  shape  these  loci  may  assume;  for,  if  one  can 
correctly  predict  the  shape  of  a  locus  of  relative  minima,  then  the  number  of  two- 
dimensional  scans  can  be  greatly  reduced.  The  locus  in  Fig.  C.  4.  2  is  certainly  one 
possible  candidate  for  a  locus  of  relative  minima  in  the  b^  -  c  plane.  For  b^  equal  to 


Figure  C.  4.  2  A  possible  candidate  for  the  locus  of  relative 
minima  of  max  E[b„,  c  , /till,  b.  fixed  and  c  variable. 
Ml  [t  r  t  jj  i 


there  are  three  values  of  c^_  each  leading  to  exactly  the  same  numerical  relative 
minimum  of  the  discrete  version  of  Eq.  {C.  4),  with  b^  =  b^  .  One  sees,  from  Eq.  (C.  19), 
that  this  means  that 


E  b?,  c4,  t“4 


=  Elbr  c-10,  t? 


Elb?,  c17,  t7>17 


(C.  21) 


which  is  illustrated  in  Fig.  C.  4.  3. 

It  seems  highly  improbable  that  this  locus  could  be  representative  of  physical 

reality,  for  the  condition,Eq.  (C.  21),  is  so  stringent  that  one  must  seriously  question 

its  plausibility.  A  similar  argument  can  be  given  for  a.  parabolic  locus.  In  this  case 

Eq.  (C.  21)  reduces  to  an  equality  between  two  values  of  the  error.  Based  upon  these 

arguments  we  shall  hypothesize  the  following:  the  locus  of  relative  minima  of  Eq.  C.  4) 
rr  ,  '  \  )  " 

is  either  monotonically  increasing  or  decreasing..  While  this  has  not  been  proven 

rigorously,  it  is  interesting  to  note  that  in  every  case  (32  in  all)  the  computer  results 

agreed  with  the  hypothesis. 
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By  knowing  the  shape  of  the  locus  one  is  able  to  extrapolate  it  in  either  direction. 
Thus,  computational  time  may  be  minimized  if  the  procedure  outlined  below  is  used 
as  the  basis  of  the  computer  program. 

(1)  Obtain  a  rough  idea  of  where  the  absolute  minimum  of  Eq.  (C.  4)  is  by 
following  the  procedure  outlined  in  Section  C.  2  for  fairly  large  increments  Ab  and  Ac. 

In  this  case,  step  (4)  must  be  modified  so  that  the  computer  will  repeat  steps  (1)  and  (2) 
for  a  fixed  value  of  b^  (c^J  while  scanning  the  c^  (b^)  space.  The  result  in  step  (5)  will 
then  correspond  to  a  single  point  on  the  locus  of  relative  minimia  of  Eq.  (C.  4).  This 
entire  procedure  must  then  be  repeated  for  a  number  of  the  fixed  b^  .  By  properly 
spacing  the  b^  it  should  be  possible,  after  five  or  six  runs,  to  get  a  rough  idea  of  the 
shape  of  the  locus.  Associated  with  every  point  on  this  locus  will  be  a  numerical  value 
for  the  error.  By  means  of  extrapolation  this  step  can  be  repeated  until  the  error 
gives  the  appearance  of  having  passed  through  an  absolute  minimum. 

(2)  Fixing  our  attention  on  a  region  in  the  vicinity  of  the  point  of  the  apparant 
absolute  minimum  we  can  interpolate  the  results  and  then  reprogram  the  computer  so 
that  it  repeats  the  entire  procedure  outlined  in  (1)  above  for  smaller  increments  in  the 
b^  and  c^_  .  This  procedure  may  have  to  be  repeated  several  times,  where  in  each  case 
the  Ab  and  Ac  are  made  smaller.  Of  course,  the  number  of  times  this  is  done  is  really 
dependent  upon  the  desired  accuracy. 

A  word  of  caution  is  necessary  here  to  dispel  any  thoughts  of  skipping  this  step. 

It  is  possible  that  one  may  miss  a  very  sharp  absolute  minimum  by  using  the  coarse 
scan  in  step  (1)  and  that  one  would  probably  also  miss  it  in  this  step  if  Ab  and  Ac  were 
not  chosen  small  enough.  Examples  as  drastic  as  this  are  unlikely  ;  however,  it  is 
important  to  realize  they  can  occur.  In  general,  if  one  is  not  certain  about  the  location 
of  the  absolute  minimum,  he  should  scan  again. 

34 

Bellman  points  out  that  the  problem  of  distinguishing  an  absolute  minimum 
from  relative  minima  is  one  that  plagues  the  optimization  field.  Computer  results 
indicate  that  this  problem  usually  arises  in  step  (1)  of  the  above  procedure.  If  this  does 
occur,  step  (2)  must  be  repe.ated  in  the  vicinity  of  each  one  of  the  relative  minima. 

While  this  sounds  like  a  great  deal  of  work  it  certainly  is  far  less  than  would  be  required 
had  one  scanned  the  entire  two-dimensional  b^  -  c^  domain  in  a  haphazard  way. 

These  results  may  be  carried  over  en  mass  to  the  ITnAE  criteria;  however,  due 
to  the  fact  that  the  ITnAE  criteria  are  only  functions  of  Band  C  some  of  the  computer 
operations  in  Section  C.  2  must  be  modified  accordingly. 

*  See  ref.  34  for  a  complete  discussion. 
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APPENDIX  D.  TABULATION  OF  THE  COEFFICIENTS  CR  IN 

— 

fa(t)  =  E  Ck+k(t)> 
a  0  K  k 


T 

Criterion  I 


Condition  for  determining  C 


IE  IK  0 

ITE  ITE  -  0 

it2b  ir2E-o 

IT',/2E  IT*,/2E-0 


1C2  Orthonormall 


ITE2  I  Orthonormall  aatioi 


Talilo  D.2  l(t)  i"2t-  e"41  ;  ■-  O0<"3t,  A.  0.  (F^)  »  1. 

Criterion  Condition  for  determining  CQ  CQ 

IE  IE  i  0  0.7500 

ITE  ITE  --  0  1.6850 

rr2E  it2e-o  1  2. 950D 

1/2_  |T«t/2|;.  1,  0.3580 


IT",/ZE2 

OrUmnormall  ration 

AE 

Digital  computer  solution  of  min  AE 
°0 

OrtlionormalUntlun 

0.3432 

ITE2 

Orllionorma  11  ration 

0.7020 

it",/2e2 

Or  tlionor  mall  ration 

0.  1 6B3 

AE 

Digital  computer  aolutlon  of  min  AE 

co 

0.  17 

Condition*  for  determining  Cfl  and  Cj 


IT  E  -.0,  ^(7)  M  } 
IT‘i,4e  .  n,  t  I,  )  H- 


Orthono  rmalir.nllon 


IAE  Digital 


ITAE 


IT"*^2AE  Digital  computer  aolminn  of  min  IT"*  2AE  j0 


124 


u° 

g 

o 

© 

1 

1 

s 

o 

O' 

O 

o 

5 

o 

s 

? 

.  ^ 

g 

Condition  for  determining 

| 

rJU 

fc: 

2 

2 

1 

.  E 

0 

0 

3 

0 

”3 

£ 

E 

0 

5 

o 

jj 

- 

1 

■S 

6 

a 

!o° 

3 

u 

s 

3 

3, 

s 

1 

a 

H 

•S  ° 
go 

§ 

•* 

a. 

| 

3 

5 

ja 

Vj 

.5  © 
fiu 
*3 

0 

3 

0 

u 

3 

O. 

1 

3 

s 

e 

o 

u  “ 

u  o 

1 

B 

the  time  it  which  the  iruximum  of  f(t)  occi 


o’ 

3.7500 

7.8100  | 

- 1 

17.5600 

g 

2.5400 

3.2850 

o 

2.20 

g 

2“ 

Condition  for  determining  CQ 

a 

a 

td 

z 

0  =3zxi 

14 

5 

H 

3 

6 

| 

o 

H 

g 

1 

6 

■a 

■4 

g 

| 

6 

b4 

lo° 

*3 

1 

Q 

3 

il  O 
go 

1 

3 

a 

'i 

5  a 
go 

0 

3 

a, 

S 

1 

a 

Digital  computer  solution  of  min  IT  AE 

C0 

Error 

Criterion 

M 

H 

1 

1 

N«d 

MU 

Vj 

'4 

3 

3 

S3 

S3 

o 

O 

o 

o 

a 

o 

o 

5 

N 

H 

o 

o 

o 

o 

CO 

f- 

o 

o 

o 

N 

o 

o 

o 

o 

o° 

f 

■3 

| 

O 

a 

w 

fcj 

J4 

fUM 

•  ti 

1 

'  g 

c 

1 

O 

c 

J 

g 

c 

n 

O 

jj 

•5 

0 

S 

lo° 

“3 

1 

a 

td 

•C 

H 

!°° 

1 

a 

J3 

V* 

1° 

3 

*3 

0. 

1 

*3 

□ 

j  w  u 

a 

w 

h 

W 

*'Vj 

Jd 

1 

1 

V| 

M 

< 

3 

l 

JS 

£ 

129 


APPENDIX  E.  DATA  EVALUATION  RESULTS 

The  results  tabulated  in  this  appendix  supplement  the  discussion  cf  "data  evalu¬ 
ation"  presented  in  Section  4.  3.  Tables  E.  1-E.  9  are  the  basis  for  the  summary  figures 
Figures4.  3.  7  -  4.  3,  18,  frcm  which  the  results  in  Section  4.  4  are  obtained. 

Tables  E.  1  -  E.  8  are  based  upon  only  the  one-and  two-term  approximations 
tabulated  in  Appendix  D,  while  Table  E.  9  is  based  upon  the  three-term  approximations 
listed  in  Appendix  D  which  were  calculated  for  only  seven  of  the  eleven  error  criteria. 
More  specifically,  Tables  E.  1  and  E.  5  are  based  upon  the  six  one-and  two-term  approxi 
muttons  listed  in  Tables  D.  1  -  D.  6;  Tables  E.  2  and  E.  6  are  based  upon  the  four  one-and 
two-term  approximations  listed  in  Tables  D.  8  -  D.  11;  Tables  E.  3  and  E.  7  are  based 
upon  the  two  one-and  two-term  approximations  listed  in  Tables  D.  13  and  D.  14;  Tables 
E.  4  and.  E.  8  are  based  upon  the  six  one-and  two-term  approximations  listed  in  Tables 
D.  16  -  D.  21,  and;  Table  E.  9  is  based  upon  the  three-term  approximations  listed  in 
Tables  D.  7,  D.  12,  D..15,  and  D.  22. 

Strictly  speaking,  the  sum  of  the  numbers,  for  each  family  of  error  criteria, 
in  each  row  of  Tables  E.  1,  E.  2,  E.  3,  and  E.  4  should  be  6,  4,  2,  and  6  respectively; 
the  sum  of  the  numbers  in  each  row  of  Tables  E.  5,  E.  6,  E.  7,  and  E,  8  should  be  6,  4, 

2,  and  6  respectively,  and;  the  sum  of  the  numbers  in  each  row  of  Table  E.  9  should  be 
4.  These  numbers  correspond  to  the  number  of  approximations  used  in  the  formation 
of  Tables  E.  1  -  E.  9,  as  discussed  in  the  preceding  paragraph.  There  are  many  places 
in  these  tables,  however,  where  the  row  sums  either  exceed  or  are  less  than  the  ex¬ 
pected  total  (which  is  listed  in  a  footnote  at  the  bottom  of  each  table).  The  excess 
occurred  when  more  than  one  error  criterion  led  to  an  optimum  approximation,  in  the 
judgement  of  the  author.  In  these  cases,  the  error  criterion  corresponding  to  each  one 
of  the  optimum  approximations  each  received  a  full  point;  thus,  it  was  possible,  in  this 
way,  for  the  actual  row  sums  to  exceed  the  expected  total.  The  defecit  occurred  when, 
in  the  opinion  of  the'  author,  no  error  criterion  led  to  an  optimum  approximation  useful 
from  an  engineering  point  of  view.  This  does  not  mean  that  an  optimum  approximation^ 
based  upon  a  comparison  of  a  number  of  approximations  with  the  actual  function^did  not 
exist.  It  means  that,  in  the  opinion  of  the  author,  the  optimum  approximation  was  too 
poor  to  be  considered  "optimum"  from  an  engineering  point  of  view.  Thus,  it  was 
possible,  in  this  way,  for  the  actual  row  sums  to  be  less  than  the  expected  total. 

As  can  be  seen  from  the  preceding  discussion,  many  human  factors  such  as 
judgement,  opinion,  and  even  bias  and  prejudice  enter  into  the  evaluation  of  data  where 
"optimum"  results  are  sought.  The  results  presented  in  Section  4.  4  naturally  include 
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the  various  human  factors  that  entered  into  the  author'  s  evaluation  of  the  data.  These 
results  should  be  accepted  bearing  the  preceding  discussion  in  mind.  To  be  more  con¬ 
clusive,  this  entire  problem  should  be  repeated  by  a  group  of  randomly  chosen  investi¬ 
gators,  in  order  to  average  out  the  effects  of  judgement,  opinion,  bias,  and  prejudice. 


Table  E.  1  Frequency  with  which  an  error  criterion  leads  to  approximations 
of  best  performance  between  f  (t)  and  f(t).  Sample- space  restricted  to 
families  of  error  criteria  (IT^X,  ITnE  ,  and  AE-ITnAE  families). 


13 


Table  E.  2  Frequency  with  which  an  error  criterion  leads  to  approximations 
of  best  performance  between  f&(t)  and  f(t).  Sample-space  restricted  to 
families  of  error  criteria  (ITnE,  ITnE^,  and  AE  -  ITnAE  families). 
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Each  one  of  the  numbers  listed  in  this  table  is  a  number  M out  of  a  maximum  total  of  four11 


Table  E.  3  Frequency  with  which  an  error  criterion  leads  to  approximations 
of  best  performance  between  f  (t)  and  f(t).  Sample  -  space  restricted 

to  families  of  error  criteria  (ITnE,  ITnE^,  and  AE  -  ITnAE  families). 
-2t  -4t 

f  (t)  =  e  -  e  ;  A.  O.  (F  )  =  3;  f  (t)  restricted  to  one-and  two- 
term  approximations  (TablesaD.  13  tnl.  D.  14). 
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Table  E.  6  Frequency  with  which  an  error  criterion  leads  to  approximations 
of  best  performance  between  f  (t)  and  f(t).  Sample-space  includes  all 


136 


3 

'h 

cm 

O 

r— 1 

1 

O 

<m 

■ 

1 

r-q 

O 

O 

1 

O 

ITAE 

O 

1 

1 

i — < 

o 

O 

1 

Q 

O 

O 

O 

O 

£ 

O 

o 

r— * 

o 

o 

O 

O 

o 

O 

O 

'4 

O 

o 

- 

I- C 

(M 

CM 

1 

■ 

O 

o 

CM 

o 

o 

rq 

W 

M 

'h 

o 

1 

1 

1 

1 

1 

■ 

i  ■  4 

o 

o 

1 

o 

cq 

ti 

o 

o 

o 

O 

o 

r— ( 

o 

O 

O 

o 

o 

o 

o 

z31 

o 

o 

o 

O 

o 

o 

. 

o 

o 

o 

o 

o 

o 

o 

w 

fsl 

\ 

’h 

cm 

o 

r— * 

r— * 

CM 

1— * 

CM 

r*~ < 

I—* 

o 

1— < 

r— 4 

o 

w 

H 

o 

o 

H 

4 

O 

o 

o 

- 

o 

o 

o 

o 

o 

ITE 

o 

o 

- 

r— q 

r- * 

o 

o 

f——4 

o 

■  o 

o 

o 

o 

a 

o 

t— • 

1 — < 

o 

o 

fH 

r— q 

o 

o 

o 

o 

o 

Frequency  with  which  an  error 
criterion  leads  to  approximations 
of: 

3 

3 

W 

6 

D 

jj 

C 

§ 

Minimum  E  <}>  (jw) 

(?) 

Best  absolute -stability 
behavior,  K  >  0  ^ 

Best  absolute  -  stability 
behavior,  K  <  0  (4) 

Best  relative -stability 
behavior,  K  >  0  ^ 

Best  fit  between  fa(t)  and  l(t) 

(6) 

Best  combination  of  (1)  and  (2) 

Best  combination  of  (3)  and  (4) 

Best  combination  of  (6)  and  (i) 

Best  combination  of  (6)  and  (2) 

Best  combination  of  (6)  and  (5) 

Best  combination  of  (6),  (1) 
and  (2) 

Best  combination  of  (6),  (5), 

(1),  and  (2) 

0 


Each  one  of  the  numbers  listed  in  this  table  is  a  number  "out  of  a  maximum  total  of  four" 


Table  E.  7  Frequency  with  which  an  error 
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Table  E.  8  Frequency  with  which  an  error  criterion  leads  to  approximation 
of  best  performance  between  f&(t)  and  f(t).  Sample-space  includes  all 
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Best  combination  of  (6),  (5), 
(1),  and  (2) 
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Table  E.  9  Frequency  with  which  an  error  criterion  leads  to  three-term 
approximations  of  best  performance  between  f  (t)  and  f(l).  Sample- 

^2t  -4t 

space  includes  seven  error  criteria.  £( t)  =  e  -  e  ,  A.  O.  (F  )  = 

1.  2,  and  3  (Tables  D.  7,  D.  12,  and  D.  15);  f(t)  =  e  +e  ,  A.  O.  (F  )=  1 
(Table  D.  22).  a 


Frequency  with  which  an  error 
criterion  lead*  to  approximations 
of: 

IE 

ITE 

rr2E 

IE2  ’ 

ITE2 

it-‘/2e2 

Minimvim  E..  (jw) 

M  id 

>!< 

0 

l 

0 

3 

0 

0 

0 

| 

i 

0 

0 

1 

2 

-  H 

0 

Best  absolute-stability 
behavior,  K  >  0  ^ 

.  i 

0 

0 

2 

0 

■ 

1 

Best  absolute- stability 
behavior,  K  <  0  (4) 

i 

0 

2 

1 

1 

■ 

2 

Best  relative -stability 
behavior,  K  •>  0  ^ 

i 

0 

0 

1 

0 

1 

Best  fit  between  fa(t)  and  f(t) 

(6) 

i 

0 

0 

j 

1 

0 

Best  combination  of  (l)  and  (2) 

i 

0 

0 

1 

0 

0 

Best  combination  of  (3)  and  (4) 

i 

0 

0 

2 

0 

1 

1 

Best  combination  of  (6)  and  (l) 

0 

0 

0 

3 

0 

0 

0 

Best  combination  of  (6)  and  (2) 

i 

0 

0 

2 

1 

0 

0 

Best  combination  of  (6)  and  (5) 

0 

0 

0 

1 

0 

0 

0 

Best  combination  of  (6).  (1) 
and  (2) 

1 

0 

0 

3 

1 

0 

0 

Best  combination  of  (6),  (5). 

(1),  and  (2) 

0 

0 

0 

1 

0 

0 

0 

*  Each  one  of  the  numbers  listed  in  this  table  is  a  number  "out  of  the 
maximum  total  of  four"  . 


» 
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